A0-AQ43  857 


CLAREMONT  MEN’S  C&LL 
FINAL  REPORT. (U) 


CA  INST  OF  DECISION  SCIENCE 


F/8  14/4 


AllA  TV  i uvuDr  » 


DC  FILE  COPY'  ADA043857 


INSTITUTE  OF  DECISION  SCIENCE 

FOR  BUSINESS  & PUBLIC  POLICY 


Office  of 


(£ , , 

FINAL  REPORT  ^ s. 

Naval  Research  Grant  ^IQQQ14-76-C-Q695. ' 


Claremont  Men’s  College 
Clefemeotr  Ca Mi 

^ y • r * X) » c i _ . . i i*  * ' 


I ^ ^ T 


TABLE  OF  CONTENTS 


Page 


Final  Report 1 

ATTACHMENTS  ‘ 6 


A.  .’’Determining  Confidence  Bounds  for  Highly  Reliable  Coherent 
Systems  based  on  a Paucity  of  Component  Failures,”' 

Janet  Myhre,  Andrew  Rosenfeld,  and  Sam  Saunders. 

B.  "Problems  of  Estimation  for  a Decreasing  Failure  Rate 
Distribution  Applied  to  Reliability ^ Janet  Myhre  and 
Sam  Saunders . 

C.  - "Comparison  of  Parameter  Estimation  for  the  Pareto 

Distribution,"  James  Lucke,  Janet  Myhre,  and  Patrick 
Williams. 

D.  "HP-97  Programs  for  the  Computation  of  Maximum  Likeli- 
hood Estimates  for  the  Parameters  of  the  Mixed  Exponen- 
tial Distribution , ,r  James  Lucke. 

E.  "Reliability  Tutorial;"  Janet  Myhre. 

F.  "Approximate  Confidence  Bounds  for  Reliability:  Mixed 

Exponential  Distribution, " Janet  Myhre  and  James  Lucke. 


F 

I 


Final  Report  for  ONR  Grant  N00014-76-C-0695 


* 


; 


i 


&■ 


Office  of  Naval  Research 
Janet  Myhre 

Principal  Investigator 

During  the  period  of  this  grant  significant  progress  has 
been  made  in  determining  probabilistic  and  statistical  proper- 
ties for  the  mixed  exponential  distribution  (Pareto  Type  II 
distribution) . This  probability  law  is  proving  to  ^ an  accurate 
model  for  fitting  the  distribution  of  life  lengths  for  most  types 
of  electronic  equipment.  The  research  related  to  the  mixed  expo- 
nential has  resulted  in: 

1.  "Comparison  of  Parameter  Estimation  for  the  Fareto 

Distribution,"  submitted  to  the  Journal  of  the  American  Statistical 

W 

Association . This  paper  shows  that  the  maximum  likelihood  estimate 
for  the  scale  parameter  of  the  mixed  exponential  distribution, 
using  complete  or  censored  data,  is  at  least  as  accurate  as  BLUE 
(best  linear  unbiased  estimate)  or  modified  BLUE.  In  addition, 
it  is  shown  that  the  maximum  likelihood  estimates  are  more  versatile 
than  the  BLUE  and  modified  BLUE.  [Attachment  C]. 

2.  "Asymptotic  Distribution  of  Maximum  Likelihood  Estimates 
for  Parameters  of  the  Mixed  Exponential  Distribution  based  on 
Censored  Data."  Draft  in  preparation  for  submission  to  Technometrics 
for  publication  together  with: 

3.  "Problems  of  Estimation  for  a Decreasing  Failure  Rate 
Distribution  Applied  to  Reliability,"  which  has  been  submitted  to 
Technometrics  and  is  now  under  revision.  In  this  paper  the  pro- 
perties of  mixed  exponential  distribution  are  studied.  Simple 
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techniques  are  derived  which  yield  sufficient  conditions  for  ob- 
taining the  solution  of  the  maximum  likelihood  equations  when 
one  or  both  of  the  parameters  are  unknown,  even  when  the  data 
is  highly  truncated  or  censored,  [Attachment  B] . 

4.  "Approximate  Confidence  Bounds  for  Reliability;  Mixed 
Exponential  Distribution."  A draft  of  this  paper,  minus  compu- 
tations of  the  computer  results,  has  been  prepared.  Additional 

V 

simulations  will  be  run  in  order  to  complete  the  study.  The 

simulations  run  to  date  show  that  in  general  the  bounds  are  quite 

\ 

accurate  and  that  the  variance  of  the  distribution  of  bounds  is 
relatively  small.  This  paper  will  be  submitted  to  Technometrics 
or  Naval  Logistics  Quarterly.  [Attachment  FJ. 

5.  "Robustness  of  the  Mixed  Exponential  Distribution  in 
Fitting  Mixtures  of  Exponentials."  Computer  programs  have  been 
written  which,  for  known  mixtures  of  exponential  distributions, 
check  the  comparative  accuracy  of  fit  among  the  Mixed  Exponential 
distribution,  the  Weibull  distribution  and  the  Exponential  distri- 
bution. • Work  to  date  shows  that  under  mixtures  quite  different 
than  the  assumed  Gamma  mixture,  the  Mixed  Exponential  is  still 
fairly  robust.  This  paper  will  be  submitted  to  the  Journal  of 
Statistics  and  Simulation. 

6.  "HP-97  Programs  for  the  Computation  of  the  Maximum  Like- 
lihood Estimates  for  the  Parameters  of  the  Mixed  Exponential 
Distribution."  This  program  makes  the  Mixed  Exponential  model 

more  available  to  users.  It  will  allow  the  estimation  of  parameters 
for  small  to  moderate  sample  sizes.  [Attachment  D], 


Additional  research  completed  under  the  grant  includes: 
"Determining  Confidence  Bounds  for  Highly  Reliable  Coherent 
Systems  based  on  a Paucity  of  Failures."  This  paper  has  been 
accepted  for  publication  by  the  Naval  Logistics  Quarterly.  It 
deals  with  a computationally  simple  method  for  obtaining  confi- 
dence bounds  for  highly  reliable  coherent  systems,  based  on 
component  tests  which  experience  few  or  no  failures.  Binomial 
and  Type  I censored  exponential  failure  data  are  considered  The 
component  unreliabilities  are  ordered  by  weighting  factors  which 
are  presumed  known.  Sensitivity  of  the  confidence  bounds  to 
these  assumed  weights  is  examined  and  shown  to  be  low. 

[Attachment  A]. 

An  invited  tutorial  paper  was  delivered  at  the  1977  American 
Society  for  Quality  Control  Technical  Conference  in  Philadelphia. 
It  deals  with  decreasing  failure  rates  and  the  Mixed  Exponential 
Distribution.  [Attachment  E] . 
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ATTACHMENT  A 


DETERMINING  CONFIDENCE  BOUNDS  FOR 
HIGHLY  RELIABLE  COHERENT  SYSTEMS 
BASED  ON  A PAUCITY  OF  COMPONENT  FAILURES* 


Janet  M.  Myhre 
Andrew  M.  Rosenfeld 
Claremont  Men's  College 

Sam  C.  Saunders 
Washington  State  University 


0 . Abstract 

A computationally  simple  method  for  obtaining 
confidence  bounds  for  highly  reliable  coherent  systems, 
based  on  component  tests  which  experience  few  or  no  failures, 
is  given.  Binomial  and  Type  I censored  exponential  failure 
data  are  considered.  The  component  unreliabilities  are  ordered 
by  weighting  factors  which  are  presumed  known.  Sensitivity  of  the  confi- 
dence bounds  to  these  assumed  weights  is  examined  and  shown  to  be  low. 

1 . Introduction 

Previously,  confidence  bounds  for  general  coherent 
structures  have  been  obtained  by  using  asymptotic  methods, 
such  as  Likelihood  Ratio  [6],  Maximum  Likelihood  [8],  or 
Modified  Maximum  Likelihood  [1],  by  using  Bayesian  methods 
[7],  or  by  assuming  equal  reliabilities  for  all 
components.  Asymptotic  methods  may  be  inaccurate 
at  higher  percentiles  unless  the  number  of  failures 

•Research,  in  part,  supported  by  the  Office  of  Naval 
Research  Contract  N00014-76-C-0695 • 
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is  very  large.  With  Bayesian  methods  the  possibility  of 
inadvertently  influencing  a decision  through  the  selection 
of  a prior  distribution,  when  the  number  of  failures  is 
small,  is  well  known.  Finally,  because  the  assumption  of 
equal  reliabilities  of  the  components  may  not  always  be 
fulfilled,  the  accuracy  of  a bound  obtained  using  this 
assumption  could  be  in  doubt.  What  we  propose  here  is  to 
use  engineering  knowledge  which  can  be  gained  from  acceler- 
ated life  tests,  material  qualification  tests,  or  laboratory 
tests  of  components.  This  knowledge  can  be  utilized  in  a 
manner  that  provides  information  about  the  parameter  space. 

It  is  felt  that  this  intermediate  ground  avoids  some  of  the 
objections  raised  by  Bayesians  concerning  "classical" 
statisticians  who  operate  under  an  assumption  of  total  ignor- 
ance about  the  parameter  space.  Moreover,  it  attempts  to 
avoid  the  subjectivity  which  seems  to  hinder  the  acceptance 
of  Bayesian  methods. 

For  special  structures,  such  as  series  structures  (and 
in  some  cases  parallel  and  series  parallel  structures)  exact 
methods  [9]  and  additional  approximate  and  asymptotic  methods 
(I^J>  [5],  C9J)  for  obtaining  system  confidence  bounds  have 
been  developed.  The  accuracy  of  these  approximate  bounds  has 
been  studied  in  specific  sample  cases  for  structures  of  order 
two  or  three  (£5],  £9])-  In  this  paper  some  comparisons  are 
made  between  the  bounds  obtained  by  the  weighting  method 
developed  here  an.  approximate  (asymptotic)  bounds  for 
special  structure-,  nere  approximate  (asymptotic)  bounds  can 
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be  calculated. 


3 


2 . Binomial  Component,  Failure  Distributions 

Since  the  unreliability  of  any  practical  system  must 

be  low,  that  of  any  component  must  be  even  lower.  The 

commonly  used  technique  of  obtaining  confidence  bounds  for 

the  probability  of  success  from  sequences  of  Bernoulli  trials 

will  not  be  applicable  here,  because  virtually  all  of  the 

components  will  have  experienced  no  failures  during  their 

acceptance  testing.  Extending  an  idea  utilised  by  Lomnicki 

[3]j  we  will  examine  the  probability  of  system  failures 

expressed  in  terms  of  the  least  reliable  component . The 

estimate  of  this  quantity  is  then  used  to  construct  a lower 

confidence  bound  on  the  system  reliability. 

A qualification  test  for  each  component  consists  of 

a number  of  Bernoulli  trials  of  nominally  identical  components. 

Given  there  are  n.  trials  with  X.  failures  for  the  i n componen 

11 

then  it  is  assumed  that  the  number  of  failures  has  a 
binomial  distribution  where  q^  is  the  unreliability  and  n.  is 
the  number  of  observations.  We  denote  this  by 
X1  ~ l>(ni,qi)  for  i = l,2,...,m. 

Assume  that  may  be  expressed  for  each  i by 

m 

(2.1)  q,  = a.q  where  q = max  q.  and  0<a,<l. 

11  i=l  1 1 

For  the  present  assume  that  the  a^  are  known  a prior  1 . In 

practice  we  have  obtained  the  from  reliability  goals  and 

prediction  reliabilities.  In  order  to  obtain  a confidence 

bound  for  q,  we  make  the  following  assumptions.  Since  the  q^ 

are  small  the  distribution  of  may  be  accurately  approximated 


by  a Poisson  distribution  with  mean  A.=n.q,.  Thus,  assume 

1 11 


(2.2) 


p( Ai)  = P (niqi)  . 


(For  q^  as  large  as  .01,  this  approximation  is  valid  for  n^ 
as  small  as  10 . ) 

An  upper  confidence  bound  for  q is  obtained  in  the  usual  way 
since 


X X . „ P ( Z X ) 
i=l  1 i=l  1 


where 


m 

X = Z X 


Z XJ  = Zn.q.  = q • Z a . n . . 
1-1  1 i=l  11  1-1  1 1 


The  10032  upper  confidence  bound  for  X,  call  it  A , is  the 

value  of  b for  which 

k . . m 

Z e DbJ/j!  = 1-3  , where  k = Z X.. 
j=0  i=l  1 

It  follows  that  the  10032  upper  bound  for  the  unreliability 

q,  call  it  q , is 


(2.3) 


q = X / Z a . n , . 
u u .=1  I i 


Vie  point  out  that  the  Poisson  approximation  ' the  Pit,  mini  ns  used  above  ! 
not  necessary  for  the  calculation  of  this  ty:  - • f t und:  however,  it  dees 

greatly  facilitate  the  computation. 

In  order  to  obtain  a lower  confidence  bound  for  the 
reliability  of  a coherent  system  with  component  reliabilities 
E = (Px» • • • ,Pm) > let 

P,  = 1-Q1  = l-aj_q  for  1 = 1,..., m 
where  and  q are  defined  as  in  equation  (2.1).  System 
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reliability,  h(^) , may  no w be  expressed  as  a function  of  q 

alone.  Let  the  induced  function  be  denoted  by  the  equation 

h(o)  = h(l-a1q,  . . . , 1-a^q)  = fi(q;a) 

where  a = (a^,...,a  ).  The  function  /i(q;a)  is  strictly 

decreasing  as  a function  of  q.  Hence  a lower  confidence 

bound  on  reliability,  lt(q,a),  is  /i(q  ;a)  where  q is  an 

u — u 

upper  confidence  bound  on  q. 

To  illustrate  tiiese  concepts,  consider  the  following 
examples . 

Example  2.1:  For  the  following  bridge  structure  of  five 

independent  components: 


if  the  component  reliabilities  are  p^  for  i=l,...,5  then 
the  system  reliability  is  given  by 

h(£)  = PjPi,  + P2P5  + P1P3P5  + P2p3pi4 

— P1P2P3PJ4  - P1P2P3P5  - P1P2P4P5  ~ P1P3P4P3 

- P^P^  + 2p1p2p3pi4p5. 

Rewriting  in  terms  of  the  unreliabilities  1-p  = q = a^q 

for  i=l, . . . , 5 yields 

<i(q,a)  = l-q2(a1a2+a1<a5)-q3(a1a3a5ta2a3ai4) 

+q4(a1a2a3a4+a1a2a3a5+a1a2alja5+a1a3aj4a5+a2a3a4a5) 
-2qt';(a1a2a3a4a5) . 

From  engineering  analyses  it  is  known  that  components 
1,  2,  4 and  5 have  the  same  unreliability . However,  it  is 
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assumed  that  component  3 is  only  3/10  as  unreliable  as  the 
other  components.  Assume  the  following  weights  and  test 

results . 


component 

a . _ 

-i— 

*i- 

1 

1 

10 

0 

2 

1 

10 

0 

3 

.3 

20 

0 

4 

1 

10 

0 

5 

1 

10 

0 

Suppose  a 90%  confidence 

bound  is 

desir 

ed.  Sin 

A is  the  value  of  b for 

which  e' 

-b 

10,  so  A 

Hence  an  upper  bound  on  the  unreliability  q,  at  the  90%  level, 

5 

is  given  by  qu  = A^/  Z a^  = 2.303/46  = 0.050.  Finally, 
the  desired  90%  lower  confidence  bound  on  reliability  is  given 
by  k(q  ,a)  = 0.995- 

U 

For  bridge  structures  it  is  not  possible  to  compute 
Approximately  Optimum  [4]  or  Poisson  Approximation  [9]  bounds.  The 

asymptotic  methods  are  generally  not  applicable  unless  failures 
are  observed. 


Example  2.2:  Assume  a series  structure  of  order  five  has  known 

weighting  factors  a^  and  sample  sizes  n^^  where  i = l,2,...,5. 

For  industrial  problems  we  have  often  found  that  sample  sizes 
are  not  equal  but  are  roughly  proportional  to  the  unreliabili- 
ties with  the  most  unreliable  component  having  the  smallest 
sample  size.  One  reason  for  this  may  be  that  specialized,  complex  equipment 
often  tends  to  be  both  unreliable  and  expensive. 


.=• 
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comoonent 
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-i- 

Si- 

1/2 

ll  0 

1 

20 

1/4 

60 

1/2 

40 

1/2 

40 

Assuming  one  failure  on  component  2,  A = 3-89  at  the  90% 

confidence  level.  Using  (2.3)  we  find  that  q = .0389.  Since 
5 

/t(q;  a)  = 11  ( l-a  . q)  , our  confidence  bound  on  system  reliability  is 
i=l  x 

h(qu;a)  = .897  • 

The  bounds  obtained  by  approximate  or  asymptotic  methods  ;4\  [r 
are  much  lnwer  than  this  bound,  for  example 

Approximately  Optimum  (AO)  Bound  = .820 
Modified  Maximum  Likelihood  Bound  (MMLI)  = .819 
Poisson  Approximation  (PA)  Bound  = .806 


3-  Sensitivity  of  Confidence  Bounds  to  Assumed  Weights 

The  question  that  arises  is,  what  is  the  real  difference 
between  the  bounds  obtained  presuming  that  a is  known  when 
in  fact  it  may  not  be.  A measure  of  the  error  caused  by  this 
supposition  upon  the  bound  obtained  should  be  found.  Let  the 
estimates  made  by  the  experimenter  for  the  values  of  a*(a^, . . . ,a  ) 
be  denoted  by  ct= ( , . . . , a ) . The  estimate  of  the  upper  bound 
constructed  using  a in  equation  (2.3)  will  be  denoted  by 


m 

A / E a,  n, 
u i-1  1 3 


(3.1) 


6 


Ixample 


3 . 


Differences  between  the  exact  bounds  obtained  in 
example  2.3  and  bounds  obtained  using  various  a are  given 
below.  The  corresponding  AO,  MM LI  and  PA  bounds  are  also 
given.  (The  asterisk  by  the  a^  or  cx^  indicates  the 


component  on 

whic 

h the 

failure 

is  3.  s 

surr.ed  to 

have  occurred. ) 

Component 

n, 

— l— 

a . 

— l— 

“i— 

a.<2> 
— 1 

a.(3) 
-l 

(4) 

V 

a.(5) 
-l 

1 

40 

1/2 

1 

1/2 

1 

1/5 

1/100 

2 

20 

1* 

1/2 

1/4 

1 

1* 

1* 

3 

80 

1/4 

1/4 

1* 

1* 

1/10 

1/100 

4 

40 

1/2 

1* 

1/2 

1 

1/5 

1/100 

5 

40 

1/2 

1 

1/2 

1 

1/5 

1/100 

Bounds 

Weighting  Me 

thod 

ON 

CO 

. 906 

. 928 

• 915 

.878 

. 317 

AO 

. 820 

. 871 

. 882 

.882 

. 820 

. 820 

MMLI 

. 819 

. 916 

.950 

• 950 

. 819 

. 819 

PA 

. 806 

. 806 

.806 

VO 

o 

CO 

.806 

. 806 

Note  the  weighting  in  case  5 which  must  be  assumed  in  order 
to  obtain  confidence  bounds  which  are  close  to  the  AO  or 
MMLI  methods.  In  general,  we  would  not  expect  the  engineering 
estimates  of  the  a^  to  be  this  different  from  the  correct 
weights . 


We  now  introduce  the  following  notation  for  subsequent  use 
m ra 


a,  * a,/  Z a. 
x 1=1  1 


n—  = Z a.n,  = Ea.n./Ia. 
a i=1  i i i i i 


m 

ai ' V,Ti 


m 

n-  = Z a.n,  = 
a i=l  1 1 


= min(n1, . . . ,nm) 


5'ctini'/2'ai 


Theorc.'in  3.1  : 


Let  /i(qu;a)  denote  the  true  lower  confidence 


bound  for  a series  system  of  order  m,and  let  /i(qu;a)  be  the 
estimated  lower  bound.  Then  the  absolute  difference,  V, 
between  the  true  and  estimated  confidence  bounds  for  a 
series  system  of  binomial  components  of  order  m satisfies: 


(3.2)  V = |fi(qu;a)  - /i(qu;a)|  < ^ 
ana  if 

(3.3) 
then 


m+1 


where  s = 


n(l) 


*3  = ^3  = n 

- '“(3u;h)I  < §l(i-  {;)+  whero  =“ 


Proof  : By  definition  we  obtain  for  the  reliability  of  a 

series  system 

m m 

(3.5)  n h(£)  = II  A ( 1— a q)  = 1 - s q + s q 2 + . . . + s q 

1 la  2a  ~ — ma 


m 


m m 

where  s,  = E a.  s„  = E a,a,  ...  s = n a_,  . 
la  -<—1  1 2a  i j raa  _i  i 


ra 
£ 

1=1  i<J  x J iua  1=1 

From  (3.5), 

(3.6)  V < Ulaqa-  sloqa|  + |s2aqa-  s2oqa|  +...+  I sma<)a-snicl50 1 
Recalling  (2.3)  and  (3.1),  (3.6)  becomes 


7)  P < X 
— u 

£ai  Zc^ 

4-  \ 2 

i<.1aia.1 

i<J°iaj 

Za  n Za  n 

11  11 

+ A 

u 

( £aini) 2 

(Za^n^  2 

+ . . . 


. . .+  X. 


Ila. 


Ila, 


(Za^^)™  (£aini)m 


To  establish  (3*2),  we  note  that  If  a1>0  for  all  1,  then 


^ j cl*  3,  * . • a # 

ix<. . .<ik  11  x2  2k 


Ua^) 


— In, 


By  (3.8)  and  the  fact  that  for  positive  x and  y, 

| x-y | < raax(x,y),  expression  (3-7)  nay  be  bounded  above  by 


Ep- 

k=l\nU) 


where  s = 


vssuning  (3.3)  we  note  that  (3*7)  becomes 


(3.9)  V < ~ 


£ a. a.  - £ a.  a.  + ...+  (— I Ra.  - Hu. 
<i  1 J i<1  1 J / l 1 1 1 


A..\m  I n 


Let  t = A^/n  , then  (3-9)  becomes 

(3.10)  V £ t2  | Z a. a.  - Z ct.a.j  +...+  tm  | H a . 

i<j  J i<J  J 1 


- II  a 


Using  the  method  of  La  Grange  multipliers  on  the  first  term 

of  (3.10),  the  maximum  value  of  Z a.,  a.  , subject  to  the 

i<j  1 J 
ra 

restriction  that  £ a.  = 1 , is  obtained  at  a = 1/m 

i=l  1 J 


for  J=l,2,...,m  . Thus 


(3.11)  | £ a. a.  - £ a a | < max(  £ a. a.,  £ a. a.)  < 
Kj  1 J KJ  1 •)  ' i<j  1 J l<j  1 ^ “ 


m-1 
2 in  ' 


The  other  differences  between  the  corresponding 

symmetric  polynomials  are  certainly  less  than  unity. 

Therefore,  assuming  them  to  be  unity  and  performing  the 

ra 

geometric  sum,  £ t1  = (t J-tm+1)/(l-t)  , we  obtain  a bound 
1=3 

on  the  remaining  terms.  Assuming  (3.3),  we  obtain 

+ thus  establishing  (3.4).  || 


II  VM  " 
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For  small  n,,N,  the  bound  obtained  from  (3.2)  is 
^ -L  / 

large,  particularly  if  one  or  more  failures  have  been 

observed.  For  example  the  absolute  error  bound  obtained  for 

the  data  in  Examples  2.2  and  3-1  Is  .24.  In  practice, 

however,  when  a sampling  scheme  such  as  that  given  in 

Example  2.2  is  used,  there  is  adequate  engineering  knowledge 

behind  the  choice  of  the  so  that  errors  of  such  large 

magnitude  are  not  encountered.  If  little  is  known  about  the 

weighting  equal  component  sample  sizes  are  recommended. 
Example  3.2:  Consider  a series  system  with  equal  sample 

sizes  for  each  component: 


component 

^i- 

^1- 

*i- 

1 

1 

20 

1/2 

2 

1/100 

20 

1 

3 

1/100 

20 

1/4 

Assume  no  failures,  then  for  a 90%  confidence  level 

Au  * 2.3026. 

The  actual  error  In  computing  the  series  system 
confidence  bound  is 


|ft(qu;ot)-fe(qu;a)  |=  | . 889- . 885  | = .004 
For  this  example,  the  AO  bound  is  .892,  a difference  of  .007 
from  the  correct  bound.  However,  by  Theorem  3.1  an  absolute 
bound  on  the  error  would  be 
^2 


(a1) 


1-t 


where  t 


_u 

n 


2 . 3026  and  m 
20 


.0059 
* 3 


Obviously  if  the  true  bound  were  higher,  say  .987,  then  the  AO  would  differ  from 
the  true  by  only  .005  and  the  actual  error  would  be  only  .002.  However,  the 
point  to  be  made  Is  that  we  often  have  more  information  than  simply  the  structure 
and  the  sample  size  and  when  we  do,  it  should  be  used. 


It  should  be  not*ed  that  if  the  order  of  the  structure  is  increased  to  20 
the  absolute  error  bound  is  still  only  .0080. 


We  now  wish  to  extend  this  error  determination  to  a 
parallel  structure  of  m components.  In  general,  we  denote 
the  reliability  of  a parallel  structure  of  binomial  com- 
ponents by: 


h(£)  = 1 - n (1-p  ) . 

1 = 1 1 

Writing  h(g_)  in  terms  of  q we  obtain 


h(]o)  - ft(q;a)  = 1-  n a.q. 

i=l 


Theorem  3-2:  Let  /i(qu;a)  denote  the  true  lower  confidence 

bound  for  h(£),  and  let  /i(q  ;a)  denote  the  estimated  lower 

confidence  bound  for  h(£) . We  obtain 


(A  /rn) 

(3.12)  V = |fc(qu;a)  - Hq^a)  | < -X 

ill"! 


Proof  : (3.12)  is  proved  by  noting  that 


m m 

m m m j 5 ■]  ai  -i--iai 

(3.13)  v = I n a.q  - n a.q  I = (X  ) ^ ill 

1-1  1 u 1-1  1 u.  u (lapip®  Ua^)' 


J'l  ~ ill 

n • n aj_ 

For  a^>0,  the  quantity  P = — ^ = exp  &n  ■ — ' - 

i / r»  v III  / > 


(Ealnl> 


(fa1n1) 


maximized  when  E£n  a^  - m An(Ea^n^)  is  maximized.  This 


maximum  occurs  at  a = ( Z a.n  )/mn,  for  j=l,2,...,m 

J j_=2_  11  J 

Thus  the  maximum  value  of  P is  l/(mmIIn . ) . Since  each 


13 


terra  in  the  difference 


/ *»  \ / *•.  vin 


is  positive. 


the  absolute  value  of  the  difference  cannot  .exceed  l/(mmnn^) 
From  this  (3-13)  is  established: 

(A  /m ) ra 

Oi-sr • I! 

ilini 


Example  3-3:  Consider  a parallel  structure  of  order  two 

where  no  failures  occur  in  testing 


component 


Hi_  — i- 


2 1 20  1/10 

For  a 90$  confidence  bound  = 2.3026.  The  90$  lower  confi- 
dence bounds  for  system  reliability  are: 


/i(q  ;a)  = 1-q  II  a.  = .99834 
u a i=l  x 


h(qu;cO  = l-q^Il^  = .99970 

The  actual  difference  between  these  bounds  is  1.36*10-~\  From 
Theorem  3-2  the  maximum  possible  error  due  to  incorrectly 
choosing  the  weights  is  1.66xl0-^. 

The  AO  bound  is  .99629  with  a difference  from  the 


correct  bound  of  0.5*10 


•a 
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Y/e  now  consider  a series  parallel  structure  of  order 

k 

in  = Z m.  which  consists  of  k parallel  structures  in  series; 

1=1  1 

i.  u 

the  iLn  parallel  structure  has  components.  Partition 

£ = (P1>P2»  • • • »Pm)  into  E = ^*£2*  • • • »Ek>  where 

Ej  * <P„  +l > * ' * » Pm  + . . . +n P • Th0  reliability  of 

1 J-l  1 J 


the 


system  is  given  by  h(£)  = II  h , (£,  ) with  h.(o.)  being 

4 — *1  J*  J J 


1=1 


a parallel  structure  consisting  of  components.  Now  let 
q = max(q^, . . . ,qjn)  where  again  qi  = a^q  for  i=l , . . . ,m  . The 
corresponding  partition  of  a is  a = (a^ ,a2  , . . . ,aO  . 
Therefore  expressing  the  reliability  in  terms  of  q we  obtain 

k 

h(q;a)  = n fi.(q;a.)  . 
i=l  1 _1 

Therefore  we  establish  the  error  on  the  lower  confidence 
bound  estimate  for  a series  parallel  system  by 

r 

Theorem  3.3  : Let  be  the  true  lower  confidence 

bound  for  the  i^  (1=1 , 2 , . . . ,k)  parallel  structure  of  order 
, and  let  fi^Cq^oi^)  be  the  associated  estimate  of  the 
lower  confidence  bound.  Then  an  absolute  bound  on  error 
in  estimating  the  confidence  bound  for  a series  parallel 
system  is  given  by: 

Jr  J^  J# 

(3.14)  I n h.(q  ;a.)  - n h.(q  :a,)|  < Z e, 
i=l  1 u 1 i=l  1 u _1  “ i=l  1 


where 
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(3.15) 


that  Is  Cj.  is  the  bound  on  error  of  the  itJl  parallel  structure 
The  nj  are  the  sample  sizes  of  the  components  made  during 
the  qualification  tests. 

Proof  : By  induction.  For  the  case  when  k=l , see  Theorem  3-2. 

Let  k=2.  For  convenience  set 

ri  = ,'i(qu;-i)  and  ^i=,li(qu’-i)  ' 

1 1 2 °1  °2l  1 1 2 °1  s2  °2  1 °2  l1 

e |f'1(f2-  <$2)  + ^2(fr  *1} ! 1 lfl(f2~  *2}1  + l^2Cfl" 


i I V + ,fl"  = el  + V 


Assum'-'  expression  (3. 1*0  is  true  for  k=n  . It  holds  for 

k=n+u  since, 

n+1  n+1  n n 

q ~ ^i  + fn+l  ^ ^ -i  ~ ^n+1  ^ ^i 

i=l  1 1=1  1 n+A  1=1  ~ n+A  i=i  1 

n n n 


n+1  n+1 

n f . - n ^ 
i=l  1 i=l  ‘ 


<n+l>  * rn+l(12/l-1^1<i) 
n 

i=l^i(fn+l~  *n+l^ 

- ^fn+l"  ^n+J  + 


fn+lC  11  V n *i} 
n i=l  1 i=l  1 


n n 

n V n *i 

1=1  1 i=l  1 


If 


n n+1  n+1 

„♦!-  <„.ii  +JJV  qi  ■ JUV  qi  - * «! 


<_  (by  induction) 

n+1 


Using  a similar  partitioning  procedure  for  a parallel 


series  structure  of  order  n = L ra  , then  this  system 

i=l  1 

consists  of  k series  structures  in  parallel,  where  the 

it^1  series  structure  has  order  in.  . Then  p = (p„,...,p  ) 

x *“i  *“k 

k k 

h(j>)  = 1 - n (l-h.(£ ,))  and  fc(q;a)  = 1 - n (1-/.  (q;a.)) 

j=l  J J ' j=l  j -J 

The  maximum  error  made  by  estimating  the  lower  confidence 

bound  is  obtained  from 


Theorem  3 . 4 : Let  h(q  ;a)  =1-11  (l-/i.(q  ;a.))  be  the 

u j=l  J u J 

true  confidence  bound  on  the  reliability  of  a parallel 

k 

series  structure  of  order  ra=  Z m,  . And  let 

i=l  1 


this  lower  confidence  bound.  Then 


(3.16)  8 = |/t(q  ;a)  - fi(qn;a)|  1 E t 

1=1  J 

s.-s.ra+1  0 


where  t . = — J — J- 


and  s^  is  defined  in  Theorem  3-1  • 


Proof  : Expanding  8 we  obtain 


B=  | n_(l-/iJ(qu;aj))  - II  (1-^  (q,,  ;a< ) ) | . 


By  Theorem  3.3* 
k 

8 i z |(l-fi.(q  ja  ))  - (1-h  (q  -a  ))| 
j =1  J u J J u j 


■ jjq'YvV  ' VvV1 

where  for  the  1th  branch  of  this  parallel  structure  we 
define  (by  Theorem  3.1) 


i 


r __  r * 

T . - I ft  . ( q ; a . ) - ft  ( q ; ct  . ) | = — ' ^ 

J 1 J Mu’-j  j 1 1_s 


ia+1 


Thus  B <_  L x 
J=1  J 


Example  3 . ft  : Consider  the  following  structure. 


component 

a 

— 1~~ 

n . 
— a- 

1 

1/ft 

100 

1 

2 

1/ft 

100 

1 

3 

1/ft 

100 

1 

ft 

1/ft 

100 

1 

5 

1/ft 

100 

1 

6 

1 

150 

3/ft 

7 

1 

150 

3/ft 

8 

1 

150 

3/ft 

9 

3/ft 

250 

1/ft 

10 

3/ ft 

250 

1/ft 

EX^=  1 and  we  de 

isire 

an  80 

% confidence 

yield  Xu=  2.99 

. Simple 

calculations 

Eaini  = 950 

11 

3 
c r 

.00315 

La^n^  = 962. 

5 

^u  = 

.00311 

ft(qu;a)  = (l-(.25qu)s)(l-q’)(l-(.75qu)2)  = .99999^ 
ft(qu;a)  = ( 1-q’ ) ( 1- ( . 75qJ 3 ) ( 1- ( . 25qu) 2 ) = 


•999999  • 
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We  realize  an  actual  error  of  3.38*10  and  based  on  Theorem 


3,  a maximum  possible  error  of  3-8*10 


-5 


. Exponential  Component  Failure  Distributions 

We  now  examine  components  whose  life  lengths  are 

known  to  be  exponential.  If  the  qualification  test  time 

for  the  i^1  component  is  TT  , where  1=1,2,..., m , then  the 

number  of  failures  during  the  interval  [0,rI\]  follows  a 

Poisson  distribution  with  mean  A.T.  . Define 

m 

(^.1)  A.  = a. A where  A = max  A.  and  0<a.<l  . 


i=l 


a— 


Let  X^  denote  the  number  of  observed  failures  during  [ 0 , T ] , 

then  X^~  PCa.AT.^)  . If  all  m components  are  independent, 

EXi~  P(AIa^T. ) . 

The  upper  confidence  bound  obtained  here  is  completely 
analogous  to  the  bound  obtained  in  (2.3),  i.e.  the  upper 
100B£  confidence  bound  on  A,  say  A,  is 

x = v£aiTi  • 

Reliability  at  time  t,  R( t ; A , . . . , A ) , may  be  written 
as  h(At;a)  where  A and  a are  defined  in  (^.1).  It  follows 
that  a lower  100££  confidence  bound  on  system  reliability 

A 

is  given  by  /:(At;a)  where  a is  the  vector  of  true  weights. 


5 . Sensitivity  of  Confidence  Bounds  to  Assumed  'Weights 

When  the  true  weights  a are  estimated  by  a then  the 
estimated  100  £,%  lower  confidence  bound  for  system  reliability 
becomes 


(5.1) 


/i(At;a)  where  A = A /Ea.T.  . 
— u i i 


For  the  exponential  series  case  we  measure  error  by  means  of 
the  ratio: 


iy 


(5.2) 


f>  & fe(  At  ;a) 


/i(  At  ;a) 

We  v;ill  show  that  in  the  cane  of  equal  component 
test  times  for  series  systems,  the  above  ratio  is  identically 
one.  That  is,  the  estimate  is  equal  to  the  true  confidence 
bound  for  any  weighting  a . 


Theorem  5-1  : For  a series  system  of  order  ra, 

7 i A 


(5.3)  exp  -Aut(- 
where  T 


,,si - | R < exp  A t(~- — - ~ — 

li'(l)  1(m)/  V(l)  1 ( m ) ( 

(m) 


(1)=  rain^,...,^)  and  T(jn)=  maxCTi,...,^)  . 


If  for  i=I , . . . ,m  , T = T then  . 


-v 


(5.2Q  K( At ja)  = h.( At ;a)  = exp  ~ 

Proof  : By  expanding  the  ratio  in  (5-2)  v;e  observe 


_ h(X t;a)  _ ^4_^i  _ 

“ h(\t ;a)  -Aut  CXP  u 

exP  l^TtT  Eai 

It  is  simple  to  see  that 


la 


i 


la, 


E*iTi  E«iTi 


La 


i-  < s 1 


T(m)  " ^iTi  - T(l) 


thur 


(5.5) 


vTU)  W “ 

Therefore  based  on  (5.5) 

/ 1 
1 1 


Eai 

La. 

« l- 

EalTi 

E“iTi 

i m 

(1)  1 (m) 


exp  -At 


“ \TU)  TU). 


< R < exp  A t (— 
u It 


(1)  1 (m)/ 


If  for  all  i,  T^=  T,  then  the  inequality  expressed  in  (5.5) 


becomes 


2 . 


Lhi 

< 

1 1 

EaiTi 

£“iTi 

m ri* 

(1)  (m) 

therefore  the  ratio  of  (5-2)  is  identically  one.  That  is 

A A t -X  t 

/:( At;a)  = exp  — — la.  = exp  — —la.  = fi(At;a) 

‘ Tia . i 'l'lu  i 

a 1 

= exp  -Xut/T  . | | 

Lieberman  and  Ross  [3]  have  derived  a method  for 
obtaining  confidence  bounds  for  series  systems  whose  components 
have  an  exponential  life  distribution.  The  test  statistic 
used  in  their  method  is  based  on  the  sum  of  simulated  system 
failure  times.  For  Type  I censoring  the  Lieberman-Ross 
technique  will,  in  general,  not  utilize  all  of  the  test 
data  in  the  calculation  of  their  confidence  bound.  In 
the  case  of  no  observed  failures  the  Lieberman-Ross  method 
is  not  applicable.  As  shown  by  the  following  example, 
the  procedure  v/e  propose  is  not  hampered  by  an  absence  of 
qualification  test  failures. 

Example  5.1:  Assume  that  we  have  twenty  components  in 

series  and  that  no  failures  have  been  experienced  during 
testing.  As  is  often  encountered  in  practice,  the  test 
times  are  not  all  equal. 

component  a__  T^_ 

1 1 10 


2 through  20 


1/10 


100 
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20 

20 

E a.T 
i=l  1 

. = 200  an< 

2.9  . At  ' he 

; . l i ' : . 1 • • 

level  A = 1 
u 

. 6l . Let  t = l;  then 

A(  At ; 

a)  = exp- 

. )Q  v J ‘ 

= .977  . 

The  AO  bound 

is  .852. 

The  PA  bo 

und  is  .839. 

>1  s s uin 

e that  the 

wore  not  chosen  correctly 

but  were 

chosen  according  to  one  of  the  cases  given  below. 

component 

0<(1> 
— l 

(2) 
a . 

“i(3)  ai("} 

*• 

1 

1 

1 

1 1/10 

10 

2 through  20 

1/100 

1/2 

1 1 

100 

A( A t ;a) 

.936 

• 983 

.983  .984 

The  maximum 

difference 

from  the  i 

true  bound  is  .041. 

Based 

on  Theorem  5 

. 1 the  ratio  is  bounded  by 

. 865  5 R < 1.156. 


Thus  we  know  that  regardless  of  the  weights  the  80%  bound 
must  be  greater  than  .851  (the  AO  bound  is  .852).  Again,  the 
to  be  made  here  is  that  we  often  have  more  information  than 
simply  the  structure  and  the  sample  site  and  when  we  do,  it 
should  be  used.  For  this  example,  using  the  ratio  of  Theorem 
5.1,  it  is  possible  to  show  that  regardless  of  the  weighting 
the  true  bound  is  at  least  as  large  as  the  AO  bound  (to 
two  significant  figures). 

In  the  case  of  equal  test  times,  say  100,  the  weighting 
method  bounds  are  exact  and  equal  to  .984.  The  AO  bound  is 
also  .984. 


Theorem 


22 


5 . 2 : For  a parallel  system  of  m exponential 


components  with  0<A^t<.l  for  i=l,2,...,m  , the  difference 
(5.6)  V = |/i(Xt;a)  - /i(Xt;a)  | 

is  approximately  bounded  above  by 


(5.7) 


( Aut/m) 


m 


i2iri 


Proof  : For  a parallel  system  of  exponential  components 


m / -A,t 
R(t)  = 1-11  ll-e 
1=1  ' 


If  | Xt j < .1  then  At  - 1-e 


-At 


Therefore 


V = 


ra  . 
n Ata. 
1=1 


m „ 

• n Ata. 
1=1 


= CAut) 


m 


nai 


ITa, 


(Ja^)"'  (Ea1T1):n 


Then  by  Theorem  3.2,  V is  approximately  less  than  or  equal  to 


(A  t/ra) 
JTT 


m 


II  Tj 


1=1 


6 . Conclus ion 

The  weighting  method  developed  in  this  paper  allows 
engineering  knowledge  to  be  used  in  a very  simple  and  feasible 
manner.  If  little  is  known  about  the  weighting  factors,  then 
we  know  that  for  component  sample  sizes  of  as  small  as  20, 


# 

\ 
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if  there  are  no  failures,  the  absolute  error  bound  for  a s<„rie 

0 

system  of  order  "®"  is  still  less  than  .008.  In  practice  the 
actual  errors  induced  due  to  incorrect  choice  of  the 
weighting  factors  is  much  less  than  the  absolute  bounds. 

Sensitivity  studies  show  that  qualification  test 
sample  sizes  (test  times)  increase,  the  effects  of  the 
weights  on  the  estimated  confidence  bound  decreases.  If 
little  is  known  about  the  weighting  factors,  the  bound  on 
the  maximum  possible  error  induced  by  different  weights  may 
be  reduced  significantly  by  imposing  equal  sample  sizes 
(test  times)  for  the  components  during  testing.  Moreover, 
under  the  assumption  of  equivalent  component  test  times  in 
the  commonly  encountered  case  of  exponential  series  systems, 
the  confidence  bound  obtained  is  exact.  The  advantages  of 
the  weighting  method  proposed  here  lie  in  the  simplicity 
of  the  calculations,  the  applicability  to  any  coherent 
structure  when  few  or  no  failures  occur,  the  ability  to  use 
in  an  uncomplicated  fashion  engineering  knowledge  to  compen- 
sate for  small  sample  sizes  (test  times),  and,  for  larger 
sample  sizes,  the  insensitivity  to  the  choice  of  weighting 
factors . 


The  authors  wish  to  thank  Daniel  Giesberg  for  his  extensive 
work  on  sensitivity  analysis. 
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0.  Abstract 


In  this  paper  a nixed  exponent i al  distribution  is  studied. 
This  is  a two-parameter  family,  with  a decreasing  failure  rate, 
which  is  sometimes  called  the  Lomax  distribution  or  the  Pareto 
distribution  of  the  second  kind.  The  properties  of  this  model 
are  examined  along  with  their  implications  in  determining 
reliability  assessment.  Simple  techniques  are  derived  which 
yield  sufficient  conditions  for  obtaining  the 

solution  of  the  maximum  likelihood  equations  when  one  or  both 
of  the  parameters  are  unknown,  even  when  the  data  is  highly 
truncated  or  censored.  More  importantly,  computational  techniques 
are  obtained  and  tested  which  affect  their  efficient  calculation. 
Censored  data  is  the  usual  occurrence  when  life  testing  many 
types  of  equipment  because  the  cost  makes  complete  samples 
virtually  unobtainable. 

The  results  of  this  paper  are  applied  to  censored  data, 
(obtained  from  actual  testing  of  flight  control  electronic 
packages),  in  which  failure  observations  are  sparse. 
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Censored  Sample 

Maximum  Likelihood  Estimation 

Burn-in 
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Introduc t ion 


There  have  been  only  a few  parametric  models  extensively 
examined  for  application  to  reliability;  these  include  the 
exponential  distribution  of  Epstein-Sobel  £6 ] , the  Weibull 
distribution  [14],  and  the  fatigue  model  of  Birnbaum-Saunaers 
PO.  The  one  most  widely  utilized  for  electronic  components 
has  been  the  exponential  model,  not  only  because  of  its  simple 
and  intuitive  properties  but  also  because  of  the  extent  of  the 
estimation  and  sampling  procedures  which  have  been  developed 
from  the  theory. 

One  concomitant  development  has  been  the  investigations  of 
Barlow  and  Proschan  [2]  concerning  models  for  life  distributions 
which  are  known  only  to  have  monotone  increasing  (or  decreasing) 
hazard  rates.  Of  course,  the  exponential  family  serves  as  the 
boundary  between  these  classes  of  distributions  with  monotone 
hazard  rate  and  consequently  serves  as  an  extremum  for  the 
results  of  either  case. 

One  of  the  early  discoveries  was  that  mixtures  of  exponential- 
ly distributed  random  variables  have  a decreasing  failure  rate, 
see  Cn3  . Thus  any  two  groups  of  components  with  constant,  but 
different,  failure  rates  would,  if  mixed  and  sampled  at  random, 
exhibit  a decreasing  failure  rate.  As  a consequence,  the  family 
of  life  lengths  with  decreasing  failure  rate  certainly  arises 
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in  practice  and  particular  subsets  of  this  family  could  be  of 
great  utility  for  specific  applications,  see  e.g.  Cozzolino 
[5].  We  examine  one  such  model  with  shape  and  scale  parameters, 
call  them  a and  p respectively,  which  is  based  upon  a particu- 
lar mixture  of  exponential  distributions.  This  family  was 
introduced  by  Afanas'ev  [1]  and  later  by  Lomax  [10]  as  a 
generalization  of  a Pareto  distribution. 

Kulldorff  and  VSnnman  [9]  and  V&nnman  [13]  have  studied  a 
variant  of  this  mixed  exponential  model  containing  a location 
parameter.  They  obtained  a best  linear  unbiased  estimate  of 
the  scale  parameter  assuming  that  the  shape  parameter,  call  it 
a,  was  known  and  in  a region  restricted  so  that  both  the  mean 
and  the  variance  exist,  namely  a > 2.  When  this 
.••••st rict ion  of  a > 2 cannot  be  met  an 

estimate  based  on  a few  order  statistics,  which  are  optimally 
spaced,  is  claimed  to  be  an  asymptotically  best  linear 
unbiased  estimate  and  tables  of  the  weights  as  functions  of  the 
number  of  spacings  are  provided.  In  all  cases,  the  shape 
parameter  was  assumed  known  and  the  sample  was  either  complete 
or  type  II  censored.  It  is  contended  that  BLUE  estimates  of 
the  shape  parameter  are  not  attainable. 

Harris  and  Singpurwalla  [7]  examined  the  method  of  moments 
as  an  estimation  procedure  for  this  same  model  but  again  with 
the  shape  parameter  restricted  to  a > 2 and  with  a complete 
sample . 


In  both  papers  [ 9 ] and  [l 3 , it  is  stated  that  maximum 
likelihood  estimates  are  difficult  to  obtain.  in  a later  paper 
Harris  and  Singpurwalla  M exhibit  the  maximum  likelihood 
equations  for  complete  samples. 

In  this  paper  the  maximum  likelihood  estimates  for  both 
the  shape  and  scale  parameters  are  obtained,  jointly  and 
separately,  with  simple  sufficient  conditions  given  for 

their  existence.  These  estimates  are  derived  for  censored 
data  (and  a fortori  for  complete  samples)  even 
with  a paucity  of  failure  observations,  namely  one. 

The  existence  conditions  obtained  here  for  the  maximum 
likelihood  estimates  apply  even  to  the  case  where  the  variance 
and  possibly  the  mean  do  not  exist:  0<a<2.  Moreover,  the 

estimates  of  the  shape  parameter  a which  have  been  obtained  from 
actual  data  indicate  that  this  region  0<ct<2  is  important  because 
all  the  estimates  obtained  of  u have  been  less  than  unity. 

2 . The  Model 

We  postulate  that  the  underlying  process  which  determines 
the  length  of  life  of  the  component  under  consideration  is  the 
following:  The  quality  of  construction  determines  a level  of 

resistance  to  stress  which  the  component  can  tolerate.  The 
service  environment  provides  shocks  of  varying  magnitude  to  the 
component  and  failure  takes  place  when  for  the  first  time  the 
stress  from  an  environmentally  induced  shock  exceeds  the  strength 
of  the  component. 
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If  the  time  between  shocks  of  any  magnitude  is  exponentially 
distributed  with  a mean  depending  upon  that  magnitude  then  the 
life  length  of  each  component  will  be  exponentially  distributed 
with  a failure  rate  which  is  determined  by  the  quality  of  assembly. 
It  follows  that  each  component  has  a constant  failure  rate  but 
that  the  variability  in  manufacture  and  inspection  techniques 
forces  some  components  to  be  extremely  good  while  a few  others 
are  bad  and  most  are  in  between. 

Let  X^  be  the  life  length  of  a component  in  such  a service 
environment,  with  a constant  failure  rate  X which  is  unknown. 

The  variability  of  manufacture  determines  various  percentages 
of  the  A-values  and  this  variability  can  be  described  by  some 
distribution,  say  G . 

Let  T be  the  life  length  of  one  of  the  components  which 
is  selected  at  random  from  the  population  of  manufactured  compo- 
nents. We  denote  the  reliability  of  this  component  by  R and 
we  have 

R(t)  = P [t  > tj  for  t > 0 . 

Let  A be  the  random  variable  which  has  distribution  G . 

We  can  write  ^ 

oo 

R(t)  = EaP  Xa>  t | A = X = / e~XtdG(A)  . (1) 

0 

Because  of  having  a form  which  can  fit  a wide  variety  of  prac- 
tical situations  when  both  scale  and  shape  parameters  are  dis- 
posable, it  is  assumed  that  G is  a gamma  distribution,  i.e. 
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for  some  a>0,  p-»0 


g(  *■)  = 


r(a)  pa 


for  \ > 0 . 


That  this  assur.pt i n is  robust,  even  when  mixing  as  few  as 
five  equally  wieghted  ' ' has  been  shown  by  recent  work, 
of  Sunjata  in  an  unpublished  thesis  [12].  It  follows  from 
equation  (1)  that  tne  reliability  function  is 


-a  £n(l+tp) 


(1+tp) 


The  failure  rate  can  be  shown  to  be 


q(t)  = 


1+tp  ’ 


which  in  accord  with  the  result  of  Barlow  and  Proschan  [2], 

Is  a decreasing  function  of  t > 0. 

A similar  derivation  and  discussion  has  been  given  earlier 
by  Cozzolino  [5]  and  is  included  here  for  completeness,  as  well 
as  for  what  insight  it  may  provide  into  the  physical  meaning 
of  the  parameters. 

For  this  family,  since  £n(l+tp)  < tp  for  all  p > 0 and 


t > 0 


R(t)  > e 


-apt 


■ <i 
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This  simple  relationship  provides  a basis  for  comparison 
subsequently  with  the  exponential  model. 

It  can  be  shown  that 

E[T]  = [ p ( a-1 ) J ^ for  a > 1 

Var[T]  = a[j32(a-l)2(a-2)  ]" 1 for  a > 2 


(5) 


These  formulae  have  been  given  previously  in  numerous  places. 
When  it  exists,  the  standard  deviation  exceeds  the  mean  as 
it  will  for  all  DFR  distributions.  For  example.  If 
a = 4,  then  we  see  the  standard  deviation  exceeds  the  mean 
be  a factor  of  \/2. 

Of  course,  alternative  parameterisations  can  be  made  for 
this  same  model  of  mixtures  of  exponentially  lived  components. 
We  now  mention  such  an  alternative  parameterization  for  later 
comparison  and  discussion.  Let  a - y/p  in  equation  (2) 
and  we  obtain  the  distribution 

R(t)  = e~(r/p)^n( 1+tp)  for  t > 0 , (6) 


with  hazard  and  hazard  rate,  respectively,  given  by 


q(  t) 


_1 

1 + gt 


QU) 


dx 

1+x 


for  t > 0 . 


i 

i 

I 

l 


The  reason  for  this  parameterization  is  that  as  8 + 0 we  are 
provided  with  a meaningful  limiting  distribution,  namely  the 
exponential,  since 


However , 
longer  a 


lira  R(t)  = exp  -y 
8 0 ' 

in  the  f c rmnulat  i.on  given 

scale  parameter. 


lim 
8 -*■  0 

in  eq 


In(lnB)  I 

8 ! 


uat ion  ( 7 ) , 


-Yt 

= e 


8 is  no 


3 • Properties  of  the  Model 

We  now  turn  to  a brief  examination  of  some  of  the  properties 
of  this  family  of  distributions  as  expressed  in  the  two  alternate 
parameterizations . Let  us  introduce  the  notation  for  a random 


life  length 

T : 

T~J1(a,8) 

when 

P[T  > 

, -a£n(l+t8) 

t J = e 

for  t > 0 , (7 ) 

T~J  (y,B) 

when 

P [T  > 

, -( y/B) £n( 1 + t 8 ) 

t]  = e 

for  t > 0 . (8) 

The  first  property , which  it  has  in  common  with  the  Weibull 
distribution  (and  a fortiori  the  exponential),  is  contained  in 

Theorem  1:  If  T is  a life  length  with  survival  distribution 

J^(a^,p)  , as  defined  in  equation  (7)j  for  i = 1, . . . ,n. 
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then  a series  system  of  n such  independent  components  will 
have  a survival  distribution  J 1 ( a1+ - . • +a  , P ) in  the  same 
family . 

Proof:  Simply  consider 

: [nunC^ , . . . ,1  ) > tj  II  r [Ti  > L]  = ~ ax+.  . . +u  • II 

1=1  (1+tS)  n 

Note  that  the  remark  is  the  same  even  if  we  use  the  second 
parameterization  of  the  model,  namely, 

Corollary  1:  If  for  i = l,...,n  are  independent 


observations  as  defined  in  equation  (8)  then 


min  T..  ~ J5(y-,  + . • . + Y , P) 
i=l  1 - 1 n 


The  importance  of  this  property  is  in  the  case  of  determining 
the  time  to  first  failure  within  a fleet  of  similar  systems  which 
have  possibly  different  shape  parameters.  From  this  result  the 
appropriate  fleet  reliability  calculations  can  be  made. 

The  next  property,  which  we  consider  to  be  even  more  signi- 
ficant, is  thau  a "burn-in"  test  of  a component  will  yield  a 
residual  life  which  is  also  in  the  same  family.  The  residual  life 
T^  of  a component  is  defined  to  be  the  life  remaining  after  t^me 
h given  that  th  * component  is  alive  at  time  h , namely 


Th  = T-h | T > h . 


This  property  seems  to  be  shared  only  with  the  exponential  among 
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common  parametric  families  of  life  distributions.  The  result  is 
Theorem  2:  If  qg  is  the  hazard  rate  for  a random  variable  T 

with  parameter  then  the  conditions  for  residual  life  T^ 

to  be  in  the  same  family  is  that  for  any  h > O,0e^  , there 
exists  such  that 


q0(t+h)  = q^U) 

Thus  we  have 


for  all  t > 0. 


Corollary  2:  A burn-in  for  h units  of  time  on 

initial  life  T ~ J (a,j3)  will  yield  a residual 

Th  - J [a,p/(l+hp)j.  If  T ~ J2(r,P)  then  Th  . 


a component 
life 


with 


It  follows  that  this  life  length  model  is  "used  better  than 
new"  or  "new  worse  than  used"  in  the  sense  that  we  have  stochastic 
inequality  between  a new  component  and  one  that  has  been  burned 
in,  namely 

s t 

T < T.  for  all  h > 0. 

— h 

An  important  consequence  of  this  property  is  that  one  can 
calculate  the  value  of  the  increased  reliability  attained  by 
burn-in  procedures  as  compared  with  the  cost  of  conducting  them. 

It  has  long  been  the  practice  to  burn  in  electronic  components 
based  cn  intuitive  ideas  of  "infant  mortality"  in  order  to  provide 
reasonable  assurance  of  having  detected  all  defectively  assembled 
units.  This  model,  whenever  it  is  applicable,  makes  possible  an 
economic  analysis.  A variation  of  this  result  has  been  discussed 

^ £33. 
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4 . A Comparison  with  Exponential  Using  Heal  Data 

Data  has  been  accumulating  for  years  in  the  assessment  of  the 
reliability  of  electronic  equipment  for  which  there  was  no  adequate 
statistical  model.  The  following  difficulties  were  recognized 
by  practitioners:  1.  The  assumption  of  constant  or  increasing 

failure  rate  seemed  to  be  incorrect.  2.  However,  the  design  of 
this  electronic  equipment  indicated  that  individual  items  should 
exhibit  a constant  failure  rate.  A mixed  exponential  life 

distribution  accounts  for  both  the  design  knowledge  and  the  ob- 
served life  lengths.  Maximum  likelihood  procedures  allow  for 
joint  estimation  of  the  parameters  of  this  distribution  in  the  most 
commonly  encountered  situation  where  complete  data  is  not  available. 

We  now  give  some  actual  data  sets  from  two  different  lots 
of  flight  control  electronic  packages  which  illustrate  these 
points.  £,ach  package  has  recorded,  in  minutes,  either  a failure 
time  or  an  alive  time.  An  alive  time  is  sometimes  called  a 
"run-out"  and.  is  the  time  the  life  test  was  terminated  with  the 
package  still  functioning. 


First  Data  Set 
Failure  times: 
Alive  times: 

Second  Data  Pet 
Failure  times: 
Alive  times: 


1,  8,  10 

59,  72,  76,  113,  117,  124,  145,  149,  153, 

182,  320. 

37,  53 

60,  64,  66,  70,  72,  96,  123. 


If  we  assume  that  the  data  are  observations  from  an  exponential 
distribution  (constant  failure  rate  A ) then  using  the  total 
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life  statistic,  we  have  the  estimates  of  reliability  given  in 
the  left  hand  side  of  the  table.  If  we  assume  that  the  data 
are  observations  from  the  mixed  exponential  distribution  of 
equation  (2)  then  using  estimation  techniques  derived  subse- 
quently in  this  paper  we  have  the  estimates  for  reliability 
given  in  the  right  hand  side  of  the  table. 


Exponential  est . Mixed  exponential  est . 

of  reliability  of  reliability 


time  t 

Get  1 

Set  2 

Set  1 

Set  2 

in  min. 

Rx(t) 

R2(  t ) 

R1(t) 

r2  ( t ) 

6 

.988 

.931 

.915 

• 976 

t 

10 

.980 

• 969 

.896 

.961 

30 

.943 

• 911 

. 855 

. 396 

50 

.906 

CO 

VJ1 

C\ 

.836 

. 843 

100 

.821 

— 

. 810 

— 

t 

130 

• 774 

— 

. 801 

— 

X: 

.00017 

.00312 

a : 

.0453 

. 420 

P: 

1.03 

. 01 

f 


i 

» 


r 


\ 

f 

I 


Looking  at  the  data  from  the  two  sets  we  would  expect  that  at 
least  for  the  first  fifty  minutes  the  reliability  estimate  for 
the  second  set  of  data  would  be  higher  then  the  reliability  est- 
imate for  the  first  set  of  data,  because  in  the  first  set  3 
failures  out  of  14  trials  have  occurred  in  the  first  ten  minutes 
while  in  the  second  set  only  1 failure  out  of  9 trials  has  occurred 
in  the  first  fifty  minutes.  However,  under  the  exponential 
assumption  the  reliability  estimates  for  the  first  data  set  are 
consistently  higher. 


. a 
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Mote  that  the  mixed  exponential  estimates  are  more  consistent 
with  what  the  data  show;  that  is,  for  at  least  the  first  50 
minutes  we  expect  the  reliability  estimate  for  the  second  set 
of  data  to  be  higher  than  the  reliability  estimate  for  the 
first  set  of  data.  Beyond  this  time,  however,  say  at  100 
minutes,  the  data  indicate  that  the  reliability  estimate 
from  the  first  set  of  data  should  be  higher  than  relia- 

bility estimate  from  the  second  set  of  data.  Using  mixed 
exponential  estimates  this  is  the  case. 

A statistical  test  to  determine  whether  the  data  require  a constant 
or  decreasing  failure  rate  was  run  on  the  data  from  Sets  1 and  2. 
For  data  Set  1 we  reject  constant  failure  rate  in  favor  of  de- 
creasing failure  rate  at  the  .10  level.  For  data  Set  2 we  cannot 
reject  the  constant  failure  rate  assumption.  In  this  case, 
however,  the  constant  failure  rate  estimates  for  reliability  and 
the  mixed  exponential  estimates  for  reliability  are  close.  For 
data  Set  2 one  should  not  estimate  reliability  much  beyond  about 
70  minutes  since  we  do  not  have  data  to  support  those  estimates. 

5 . Estimation  of  Parameters  with  Censored  Data 

Let  us  assume  throughout  this  section  that  we  are  given 
tl**’’,tk  as  observeb  times  of  failure  while  t^+i » • • • »tn  are 
observed  alive-times  both  obtained  from  a life  distri- 

bution with  1 1 k 1 n . We  define  two  functions  for  x > 0 . 

n i k -1 

S,(x)  « l ln(l+t.x)  , S (x)  = tt  E (1  + t.x)  (9) 

1 1=1  1 ^ 1-1  1 

A result  on  the  maximum  likelihood  estimation  (m.l.e.)  of  the 
unknown  parameters  is  now  given  which  utilises  data  of  this  type. 
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Theorem  3 : Under  the  assumptions  and  conditions  ^iven 

(i)  When  p > 0 is  known,  there  exists  a unique 

m.l.e.  of  a , say  a , given  explicitly  by 

a = k/S1(B)  . 

(ii)  When  a > 0 is  known,  there  exists  a unique 

A 

m.l.e.  of  B , say  B , given  explicitly  by 

6 = A* 1 (0) 

where  A is  the  monotone  decreasing  function 
defined  by 

A(x)  = kS9(x)  - axS^Cx)  for  x > 0 

with  primes  denoting  derivatives, 
iii)  When  a,B  are  both  unknown,  the  m.l.e.  of  S , 
say  B , is  given  implicitly,  when  it  exists 
positively  and  finitely,  by 

8 - B ~ 1 CO) 

where  B is  the  function  defined  by 
S7 (x)  S. (x) 

°(x)  - -V-  - s^y  £or  x > 0 

/N 

and  the  m.l.e.  of  a , say  a , is  given  expli- 
citly by 

a = k/S^(8)  . 

Proof:  As  a result  of  the  testing  assumed,  we  have  observed  the 

events  [T.  • tj  for  i = l,...,k  and  [T.  > tj  for  i = k+1 n.  Then  by 

definition,  the  log- 1 ikel ihood  L is  given  by 
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, K n 

e = n f(t.)  n R(t.)  . 

i = l 1 j =k+ 1 ] 

Substituting  and  taking  logarithms  we  find 

n k 

L * k in(oS)  * a ^ ^(l  + t^fi)  - ^ £n(l+t • 0)  . 

i=l  1 j-1  J 

In  order  to  find  the  m.l.e.'s  we  consider  the  partial  derivatives, 
which  after  substitution  from  (9)  , are 

H - 5 - VB)  ■ <lc» 

||  = -asj(B)  ♦ | S2(6j  . (11) 

Thus  if  0 > 0 were  known,  we  obtain  a from  (10).  This  proves 

(i). 

Correspondingly,  if  a were  known,  the  m.l.e.  of  0 , say 
0 , is  obtained  from  A(B)  = S = 0 . So  that  0 = A (0)  . 

d p 

Note  that  A is  a decreasing  function  of  0 which  has  A(0)  = k , 

A 

A(oo)  = -na  . Thus  there  always  exists  exactly  one  solution  0 
for  any  a > 0 whenever  1 s k s n . This  proves  (ii). 

If  a and  0 are  both  unknown  then  in  order  to  obtain  the 
maximum  likelihood  estimates  jointly  we  must  solve  simultaneously 

A 

equations  (10)  and  (11).  Substituting  the  solution  for  a from 

a 

equation  (10)  into  (11)  and  dividing  through  by  k > 1 yields  0 , 
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as  the  solution,  when  it  exists  positively  and  finitely,  of  the 
equation  B(x)  = 0 where  B has  been  defined  previously.  This 
proves  (iii)  . j | 

When  both  parameters  are  unknown  in  the  J^(a,B)  distribution 
conditions  are  needed  on  the  sample  to  insure  that  the  maximum  like- 
lihood estimators  a , $ both  exist. 


Lemma  1:  A necessary  and  sufficient  condition  that  no  m.l.e.'s 

exist  for  a (censored)  sample  from  the  (a  , B)  distri- 
bution is  that  the  inequality 


k 

n 

n 

k 

n 

i y T.  y t • 

k Z-  i Z-  j 

+ V S.n(l-T .) 

* r x . (1  - x . ) 

k Z.  i j 

> y t.2 

(12) 

i = l 

j-1 

j-1 

i = l 

i = l 

be  satisfied  for  all  .x  > 0 , where 


^(x) 


t . x 
i 


1 + t . X 
1 


i = 1, 


,n 


(13) 


Proof:  From  (iii)  we  see  g exists  positively  iff  g is  a zero 

of  B(x)  on  (0,°°)  iff  it  is  a zero  of  the  function  d(x)  = 
-xS^(x)B(x)  on  the  same  interval  since  xS^(x)  has  no  zeros  there. 
Since  C = xSj^  - , we  see 

C'  = xS^'  + s'1(i-s2)  - S^SX  (14) 


where  from  (9)  we  have 
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n 


n -t.2 


5 ’ Cx)  = V J±-  , S-'(x)  = V _J— T , S’(x)  = I t 

1 y 1 T (1+tix)  V (1+tix) 


But  notice  that  C(0)  = 0 and  since 


lim  xSj"(x)  = n , lim  ^ ^ ^ 


£n(l+t .x) 
lim  — J — 


= 0 


. , ■ , x -*•  °°  1+t.x 

j=l  i=l  i 


It  follows  that  C(°°)  = n . It  is  clear  that  if  C'  (x)  > 0 for  all 
x > 0 then  the  extremes  occur  at  6 = 0,  a = 00  . Thus  the  m.l.e.'s 
do  not  exist,  but  since  the  sign  of  C' (x)  is  the  same  as  that  of 
xC'(x)  for  x > 0 , by  making  the  definitions  in  (13 ) , we  see  a 
N'ASC  that  C'fx)  >0  is  the  inequality  of  equation  (12). 


?heorem  4:  The  inequality  for  1<  k< 


k 

2 v , 

k A 


n 

, Tt,  < 
1 jti  J 


n 

y , 

.1=1 


(15) 


Is  a sufficit:  . undit ion  which  a (censored)  sample  from  a 

j (a,p)  distribution  must  satisfy  in  order  that  maximum  likeli- 
hood estimators  of  both  parameters  exist  both  positively  and 


finitely . 


Proof:  To  see  that  (15)  implies  that  6 > 0 must  exist,  we  note 
by  continuity  of  C since  C'(0)  = 0 , that  it  is  sufficient  to 
show  that  there  exists  an  x > 0 for  which  C"(x)  < 0 . From 
equation  (13)  we  find 


- I 


-tA 

w o-h^)2  * k i-X 


t . 


n 


i y _y__  y i_  + y 

k L 1 + t.x  1 + t.x  L, 

1 j=l  J i=l 


n ( 1 +t . x) 


t . 


illy  

1 f (i+ti 


C ' (x) 
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C ' ( x ) 

We  examine  lim  , making  use  of  the  fact  that 

x - 0 x 

lim  ■!,(  -ft-x  l = t and  we  use  (15)  to  insure  C"(x)  < 0 for  x 

x - 0 x 

sufficiently  small. 

We  now  examine  the  joint  estimation  problem  for  the  alterna- 
tively parameterized  model  J0(a,p)  of  equation  (8)  in  the  situa- 
tion assumed  heretofore,  namely  in  the  case  we  have  both  failure 
times  and  censored  life  times.  Since  the  transformation 
(a,p)  -*  (a/p,p)  is  one-to-one  for  a,p  > 0,  the  maximum  likelihood 
estimators  of  y,p  are  immediately  obtained.  One  must  check 
that  at  the  boundary,  p = 0,  the  maximum  likelihood  estimator 

Y reduces  to  the  usual  estimate  obtained  in  the  case  of  constant 
failure  rate.  But  this  can  be  done  straight fo: wardly . 

We  state  formally 

Theorem  5;  Under  the  assumptions  and  conditions  given  for  a 
sample  from  a distribution  when  both  parameters  are 

unknown  the  m.l.e.  of  P is  implicitly  given,  when  it  exists 

A » ^ 

by  p = B (0)  where  B was  defined  in  Theorem  3,  and  the  m.l.e. 

of  y is  given  by  y = — . But  in  the  case  of  p = 0 we  have 

l§ 

n 

Y = k/  22  t . which  is  the  usual  estimate  of  a constant  failure 

1 1 

rate  using  the  total  life  statistic. 
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Remark:  A complete -sample  of  failure  times  will  satisfy  (15)  iff 
the  sample  standard  deviation  exceeds  the  sample  mean. 

Of  course  from  equation  (5  ) and  the  comment  following  we  see 
that  for  the  J (ct,B)  parameterization,  the  standard  deviation 
does  exceed  the  mean  for  those  values  of  the  parameters  where  the 
mean  and  standard  deviation  exist.  Thus  for  all  complete  samples 
which  are  sufficiently  large,  this  requirement  should  be  satisfied 


Remark:  A sample  with  k < n failure  times  and  the  remaining  n-k 

observations  truncated  at  tQ  will  satisfy  (15)  if 

2 n-k 


fc0  " nl 


1 + 


2k 

n-k 


+ 1 


'1  n-k 


for  n large  (1 6 ) 


where  n1  = ( t^+. . . +tk)/k  is  the  average  failure  time. 

2 2 2 

Proof:  To  see  this  note  always  t ^ +...+t  > (n-k)tQ 

we  are  assured  that  (15  ) must  hold  if 


and  thus 


co2  > 2Vi  * KTk  U1>2  • 

By  the  quadratic  formula  this  is  equivalent  with  equation  (15), 
with  the  second  expression  following  from  the  first  two  terms  of 
the  binomial  expansion.  | | 

In  the  calculation  of  B the  equation,  C(B)  = 0 , must  be 
solved  where  C(B)  = BS^(B)S2(B)  or 


C(B) 


y V_ 

ja  1+tJ6 


V Inlltt  I]  y ■ 

i-1  J i.l1+v 
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where  arc  failure  times  and  t^.+  j t are  censored 

life  times.  We  introduce  notation  for  the  sample  moments  as  follows 


- b I 


for  r=  1,2,3,...,  (17) 


then  using  the  two  expansions,  valid  for  |x|  < 1 , 


£n ( 1 +x) 


2 3 

x - + 2L_ 

X 3 


1 - x + x' 


and  substituting  into  C and  simplifying  we  find,  upon  neglecting 
terms  of  third  order  in  B , that 


(l*n1e*n2B)  CCJ-C2  f *c3  f ) - 


Multiplying  the  first  two  together  and  collecting  terms  yields 


' "l^l 


n -|  C i ) B * ( £ 3 " n 2 s ^ 


nl  ^2  2 


Now  we  notice  that  the  condition  equation  (15),  can  be  writ- 
ten in  the  notation  of  (17)  as  £ ^ > • 

Thus  our  computational  procedure  to  decide  upon  the  parametric 
representation  of  the  distribution  governing  the  observations  which 
have  been  obtained  is  contained  in  the  following. 

Algorithm:  Given  t^,...,t^  as  failure  times  and  t^+^,...,t  as 

censored  times  from  a J^(a,B)  distribution 

(i)  Compute  the  sample  moments  Ht,  ^2*  £3  • 
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(ii)  If  < 2^^  , assume  observations  are  from  Jo(.y,0) 
i.e.  constant  failure  rate,  distribution  and  estimate 

Y by 


(iii)  If  5 assume  observations  are  from  J (a,p) 


I 

i 

. 

I 


: 


t 


distribution  and  compute 


2£ 3 - 2r)241  - p1^2 

then  use  the  Mewton-Raphson  interation  procedure,  namely 
for  n = 0,  1,  2 


c<en> 

- 777TT'  P * 1Im  pn  ' and 
C ' ( p ; n -*■  « 


a = 


Z In ( 1 + 1 , p ) 

J-l  J 


Practical  experience  indicates  that  the  iteration  converges 
very  rapidly.  Since  the  functions  are  very  simple  a small  pro- 
grammable electronic  calculator,  such  as  the  HP-65,  can  be  used 
to  obtain  these  estimates.  Programs  for  the  HP-65  and  HP-97 
are  available  from  the  authors. 


7.  Conclusion 

If  a component  has  a life  distribution  with  an  increasing 
failure  rate,  the  Information  necessary  to  estimate  its  parameters 
must  contain  failure  times.  In  practice  this  means  that  virtually 
no  observed  failures,  within  a fleet  of  operational  components, 
provide  little  information  with  which  to  assess  reliability. 


•I 
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If  a component  has  a constant  failure  rate  then  both  failure- 
times  and  alive  times  contribute  equally  to  its  estimation. 

The  preceeding  study  suggests  that  if  a component  has  a life 
distribution  with  decreasing  failure  rate  it  is  the  alive  times 
within  the  data  which  contribute  principally  to  the  estimation 
of  the  parameters. 

The  problem  of  obtaining  the  usual  sampling  distributions 
of  the  maximum  likelihood  estimators  of  the  parameters  for  the 
decreasing  failure  rate  model  studied  seems  to  be  difficult 
because  the  estimates  are  only  implicitly  defined.  Moreover, 
the  usual  proofs  for  the  asymptotic  normality  of  the  MI/ 
which  define  the  asymptotic  mean  and  variance > do  not  apply 
even  when  censoring  is  type  I or  type  II.  A useful  asymptotic 
theory  must  be  developed  for  the  general  censoring  model. 
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ABSTRACT 


The  maximum  likelihood  estimate  (MLE)  for  the  she; 
parameter  of  the  mixed  exponential  ( Pareto,  second 
kina)  distribution  is  compared  to  the  best  linear 
unbaised  estimat*  (BLUE),  asymptotically  best  linear 
unbiased  estimate  (ABLUE)  and  the  best  Linear  un- 
biased estimate  based  on  k order  statist!  :s  (BL  E.  ). 
The  MLE  is  seen  to  be  more  flexible  and  at  least  as 
accurate  as  the  Li;'..-;.  For  censored  data  the  MLE  Ls 
generally  more  accurate  than  the  ABLUE  or  BLUE.  . 
Estimation  of  the  distribution  function  using  joint 
MLE’s  >f  the  scale  and  shapi  parameters  c mpared 
favorably  with  the  estimation  of  the  distribution 
function  using  BLUE^  for  the  scale  parameter  and  known 
shape  parameter. 


Key  words : 


Pareto  distribution 

Mixed  Exponential  distribution 

S irnulat  ion 

best  linear  unbiased  estimation 
Maximum  likelihood  estimation 
Censored  data 


COM!  AHi. ' :J  OF  PARAMETER 


TiHATIOM 


FOR 


A RE  TO  DIoTHiii'JTX' 


i.  lu'YRGDUCTiOE 

The  mixed  exponential  distribution,  often  calls. ; 
the  Pareto  or  Lomax  distribution,  a as  the  distribution 
function : 

F(x)  = 1 - (l+px)~‘l 

Tnis  distribution  has  proven  to  be  useful  in  re  lias  ill 
applications  for  representing  th  listribution  f fail 
ure  times  of  electronic  equipment  (Myhre  and  Launders, 
1976) . 

The  estimation  of  the  parameters  of  this  distri- 
bution has  been  discussed  in  numerous  papers.  Kull- 
dorff  and  Vannman  (1973)  have  derived  the  best  linear 
unbiased  estimate  (BLUE)  of  the  scale  parameter,  1/p , 
for  known  values  of  the  shape  parameter,  i ■ 2.  F »r 
known  a - 2 an  asymptotic  best  linear  unbiased  esti- 
mator (ABLUE)  for  1/p  is  also  derived.  These  proce- 
dures require  a complete  sample;  however,  a censored 
sample  may  be  used  by  ignoring  the  times  after  trunca- 
tion. Vannman  (1976)  more  recently  has  derived  for1 
known  alpha  a BLUE  estimate  of  1/P  for  censored  data. 
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only  restriction  of  the  procedure  is  thai 


k < n + 1 - 2/a  where  n is  the  sample-  si  and  k is 
th<  number  of  failures.  Each  of  these  estimat j n 
procedures  assumes  the  knov.'lodge  of  the  snaj  ■ pam:\— 
eter.  BLUE  est  imates  of  the  shape  parameter  are  n t 
attainab le . 


Harris  and  Singpurwalla  ( 1963)  used  the  method  of 
moments  as  an  estimation  procedure  but  this  again  was 
for  a complete  sample  and  with  the  restriction  of 


a * 2.  In  both  Harris  and  Singpurwalla  (1968)  and 
Kulldorff  and  Vannman  (1973)  it  is  claimed  that 
maximum  likelihood  estimation  is  difficult  to  btain. 
However,  in  a later  paper  Harris  and  Singpurwalla 
(1969)  exhibit  the  maximum  likelihood  equations  for 
complete  samples. 

In  a paper  by  Myhre  and  Saunders  (1976)  maximum 


likelihood  estimates  are  derived  for  both  the  shape 


parameter,  a,  and  the  scale  parameter,  p,  for  censored 
or  complete  data.  The  joint  MLE  of  a and  p for  a 
sample  consisting  of  k failure  times  t-,,...tj.,  and 
n-k  success,  times  t,  , ...t  , requires  trie  numeric 

K."*’  J.  fl 

solution  of: 

, k i n n t ^ p 

H(p)  = £ L (l+t.prl  Z ln( 1+t . p ) - Z = 0 

K i = l 1 j = l J j=l  1 V 


/ 


■A 


1 


J 

- 

to  obtain  0 while  fi  = — 

n 

Z ln(  1+t  . [1 ) 

1=1 

A sufficient  condition  for  : i ( 0 ) = 0 for  some  t 0 is 
that 


. giv  a for  such  a sample  requires 

solution  of: 

n , k 

A(f  = a £ ( : + 1 . p ) ‘ + £ 1+ 1 . p ) ‘ -no  = 0 . 

j=l  J i=l  1 

As  A(0)  = k a. . . as  A : is  : iecreasing  functi  >n  w Lth 

lira  A ( 0 ) = -no,  a unique  solution,  p , always  exists. 

S-»’» 

Wh  Lie  the  MLE  * s are  not  Ln  ;enerai  s uit  ib  1<  for  hand 
calculation,  their  existence  is  not,  restricted  by  the 
type  of  censoring  or  by  the  requirement  that  alpha  be 
known . 

In  this  paper  the  MLE  procedure  of  Myhre  and 
Saunders  (1976)  is  compared  with  the  BLUE  and  ABLUE 
procedures  described  in  Kulldorff  and  Vannman  (1973) 
and  Vannman  ( 1976).  For  complete  samples  with  a.  > 2 
we  know  (Kuldorff  and  Vannman,  1973)  that  the  BLUE 
and  the  MLE  have  an  asymptotic  relative  efficiency  of 
one.  However,  for  reliability  applications  it  is 
usually  found  that  o ^ 2 and  that  the  sample  is 


' . 


cens  red.  For  these  cases  the  variance  f the  BLUE, 
does  not  exist  and  hence  no  relative  efficiency  with 
the  MLE  can  be  computed.  rherefore , ■ mparisons  are 

made  using  simulation  techniques  with  particular 
al  ■ ention  to  cens  >re  1 dat  a an  1 i s 2. 

2.  oIMuLATIOM  MODEL 

In  a simulation  comparing  the  BLUE  (Kulldorff 
ind  Vannman,  L973)  and  the  MLE  of  1/p,  n failure  tin  rs 
are  generated  from  the  distribution 
G(x)  = 1 = (1+xp)  a for  fixed  a and  p. 

The  times  are  ordered  and  for  complete  samples  the  two 
estimates  are  :omputed.  In  the  case  of  lata  1 ns  r<  3 
on  tne  k^n  ordered  observation  (Type  II  censoring) , 
the  MLE  uses  all  the  data  whereas  the  BLUE  used  only 
the  first  k failure  times  (observations).  For  com- 
I Lete  samples,  a > 2,  the  BLUE  was  no  better  an  est  L- 
mate  than  the  MLE  and  for  censored  data  the  MLE  was 
always  a closer  extimate  than  the  BLUE.  ?Jo  other  simu- 
lations using  the  BLUE  procedure  (Kulldorff  and  Vannman, 
1973)  were  made. 

In  simulations  comparing  the  ABLUE  of  Kulldorff 
and  Vannman  ( 1973)  and  the  MLE  of  Myhre  ami  Launders 
(1976)  for  Type  II  censoring,  n observations  are  gen- 
erated from  a fixed  a,  p,  ordered  and  the  first  ten  are 


r 


kept  while  the  rent  are  set  equal  to  the  tenth  fir  . 

The  ABLUE  estimates  of  1/P  are  then  made  and  compared 
with  the  MLE.  The  truncati  n is  >n  the  tenth  rder<  1 
observation  as  ten  is  the  largest  number  for  which 
computational  tables  are  available  in  Kulldorff  and 
Vannman  (1973).  These  simulations  are  run  for  n = yO  , 
LOO*  kOO ; a = . 5 , 1.0,  1.3,  2.0,  2.3;  an d selected 
values  of  p.  The  ABLUE  was  a more  difficult  procedure 
to  use  than  the  BLUEj , but  the  MLE  was  again  the 
superior  estimator. 

The  BLUE  developed  in  Vannman  (1976),  to  be  re- 
ferred to  as  the  BLUE,  , is  a more  versatile  est  imate 
than  the  BLUE  and  AL..UE  developed  in  Kulldorff  and 
Vannman  (1973)  and  was  therefore  the  subject  of  a more 
thorough  investigation.  In  order  to  reflect  prae*  i cal 
applications  in  which  tests  are  not  only  truncated  on 
time  (Type  I censoring)  or  number  of  failures  (Type  II 
censoring)  but  are  also  randomly  truncated,  simulations 
were  conducted  for  all  these  types  of  censoring.  The 
BLUE,  is  based  on  k order  statistics,  where  k is  known, 
it  is  possible,  however,  to  compute  an  estimate  of  1/P 
based  on  the  BLUE,  procedure  using  Type  I or  using 

K 

random  censored  data  by  letting  k be  the  number  of 
failures  (observations).  While  this  procedure  is  not 
mathematically  precise,  it  will  be  shown  that  the 


i 

I 


1 t i v<  . . ' ■ I tween  the  BI  in d . . . . ; . 

K. 
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ilowever,  in  practice  the  shape  parameter,  a,  is 
not  known  and  the  parameters  a and  p must  he  estimated 
jointly.  This  join-  estimal  : >n  ( >r  even  estimati  n >f 
a with  known  p ) is  not  possil  le  with  BLUE,  ABLUE,  >r 
BLUE,  methods.  Therefore,  in  practice  the  joint 

it 

RLE  procedure  would  be  used  even  if  the  RLE  of  1/p 
was  not  more  accurate  than  the  BLUE.  (BLUE).  H >wev<  r, 
the  RLE  for  1/p  is  generally  more  accurate  than  the 
BLUE,..  and  in  addition  the  estimation  of  the  distribu- 
tion function  using  joint  RLE's  of  the  scale  .•  pe 

parameters  compare  favorably  with  the  estimation  of 
the  distribution  function  using  the  BLUE,  for  the 
ali  parameter  and  known  shape  parameter. 
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HP-97  PROGRAMS  FOR  THE  COMPUTATION  OF  MAXIMUM  LIKELIHOOD 


ESTIMATES  FOR  THE  PARAMETERS  OF  THE 
MIXED  EXPONENTIAL  DISTRIBUTION’ 

Reliabi  ity  models  for  electronic  components  must  be  flexible 
enough  to  handle  both  complete  and  truncated  data  and  the  compu- 
tations involved  should  be  straight-forward.  For  these 
reasons,  as  well  as  its  appealing  intuitive  properties,  the 
exponential  model  has  been  used  extensively.  However,  in  many 
applications  it  cannot  be  assumed  that  the  components  have  a 
constant  failure  rate  and  for  these  cases  the  mixed  exponential 
model  has  been  developed.  This  model  can  be  thought  of  result- 
ing from  a mixture  of  constant  failure  rates  and  results  in  the 
! distribution  F(x)  = 1 - (1  + px)~a  with  reliability  R(t)  = 

(1  + pt)~a  and  a decreasing  failure  rate.  This  model  has  been 
studied  in  reports  1,  2,  3,  and  in  2 it  is  seen  that  the 
maximum  likelihood  estimates  of  a and  p are  preferable. 

The  M.L.E.  of  p and  a for  a sample  of  k failures 

t.  , ...,  t,  and  n=k  alive  times,  X,v, , , ...»  t requires 

j.  c.  x i\+i  n 

the  numeric  solution  of 

> 

k , n n t . p 

\ H ( p ) = 1/k  Z (1  + t.p)-1  Z ln( 1 + t.p)  - Z J ■ = 0 

i-1  1 j=l  j j=l  1 + V 

» k 

for  p and  a = 

n ^ 

,1  Z In  ( 1 + t , p ) 

1=1  1 

A sufficient  condition  for  H(p)  = 0 for  some  p > 0 is  that 

k \ / n \ n 2 

Z 1 I 2 t,  I < 2 t,  . If  p cannot  be  found 

1=1  7 \j=l  '/  j=l  J 

then  the  exponential  model  should  be  used  with  \ = k/^Zt^  . 


2 


As  the  solution  of  H(p)  = 0 can  only  be  attained  by 
iterative  methods,  programs  for  the  HP-97  have  been  developed 
which  allow  the  user  to  compute  p and  a for  a test  of  not 
over  twenty  items.  The  first  program.  A,  will  test  the 
sufficient  conditions  for  the  solution.  The  second  program, 

B,  will  use  interval  halving  to  approximate  p,  the  solution 
of  H(p)  = 0,  accurate  to  within  an  error  of  .0001.  The  third 
program,  C,  will  use  this  p to  approximate  a . 

These  programs  will  allow  the  mixed  exponential  model  to 
be  used  as  extensively  as  the  exponential  model  in  applications 
of  reliability  theory. 


3— 


INSTRUCTIONS 


Store  n,  the  number  of  items  on  test  in  E,  and  k 
the  number  of  failures  in  D.  Store  the  time  t^,  failures  first, 
in  the  registers  one  through  n,  where  n ^ 20.  After  the 
data  has  been  input  the  programs  may  be  run  in  order  without 
re-entry  of  the  times. 

Program  A will  return  + 1 if  the  sufficient  conditions 

are  met  and  the  user  should  run  program  B.  If  the  conditions 

are  not  met,  -1  will  be  returned  and  the  reliability  is 

-At 

estimated  as  R(t)  = e where  A.  = 


X ti 

i=l 

Program  B will  return  an  approximation  of  ^/?  with 
error  .0001.  If  no  estimate  occurs  between  0 and  50  the 
program  returns  a negative ^and ;as  above, the  reliability  should 
be  computed  as  R(t)  = e ^ 


A 


Program  C will  return  based  on  the  data  and  the 
found  by  program  B. 


PROGRAM  A 


PROGRAM  B 


PROGRAM  C 
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I.  DISTRIBUTIONS  IMPORTANT  IN  RELIABILITY  THEORY 

4 

1 . Basic  Definitions 

Let  the  random  variables  T denote  the  time  to  failure  for  a "new" 
component  or  structure. 

The  distribution  function  at  time  t is  defined  by 


F(t)  = P[T  5 t] 
0 t 


The  reliability  at  time  t is  defined  by 

R(t)  = P[T  > t] 


0 t • 

The  conditional  probability  of  failure  during  the  interval  (t,t+At) 
Is  given  by 

F(  At  1 1 ) = ^ 

P[T  > t] 

* iwuw. m» y 

0 t t+At 


Failure  rate*  at  time  t is  defined  by 


r(  t) 


1 im 
A t^O 


F( At | t) 
At 


0 

As  At-*0,  (t  + At)  - t. 


t t + At 


*r(t)  is  known  by  a variety  of  names  such  as  hazard  rate,  force 
of  mortality,  intensity  rate. 


Research,  in  part,  supported  by  the  Office  of  Naval  Research 
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If  the  probability  dene  it y 


f unc t ion  , f ( t ) , ** 


r(  t ) 


f(  t) 
H(t) 


exists,  then 


An  increasing  failure  rate 
is  eauivalent  to  a decreas 


implies  war  out.  A decreasing  failure 
ng  conditional  probability  of  failure. 


rate 


2 . D 1 s t r i but  ions 

2.1  Exponential  Distribution 

The  prooab  il  iTy'"TIerrsTty~ 
function  is  given  by 

f(t)  = \e_U  t 2 0 

= 0 elsewhere 


f(  f ) 


r ( t ) 


It  is  easily  shown  that  the 
failure  rate  r(t)  = The  mean 

time  to  failure  is  1/^. 


■> 


t 


It  follows  that  the  conditional  probability  of  failure  during  the 
interval  (tQ»t  +t)  is  given  by 

P ( t It)  = U 

which  is  independent  of  the  time  t^.  For  example,  the  conditional 

probability  of  failure  during  the  interval  (100  hours,  200  hours)  is 
identical  to  the  conditional  probability  of  failure  during  the  interval 
(1000  hours,  1100  hours). 

2 . 2 Poisson  Process 

If  the  intervals  between  successive  events  are  independent  iden- 
tically distributed  according  to  an  exponential  distribution  with  fail- 
ure rate  X.  then  the  number  of  events  which  occur  during  the  interval 
[0,t]  has  a Poisson  distribution  with  mean  value  \t.  Also,  if  the  num- 


b 

= / f(t)dt. 
a 


»» Recall  that  f(t)  = -r-— - 


Also  P(a 


T < b) 


ber  of  events  which  occur  during  th"  interval  LO,tj  has  a Foisson  dis- 


tribution with  mean  value  X.t  then  tiie  T.  are  independent  idt.nticall 


distributed  as  exponential  variables  with  failure  rate  \. 


For  example,  if  the  intervals,  between  successive  events  are  inlo 
pendent  identically  distributed  accordin'’;  to  an  e xponeritia  1 iistributis 
with  \ = 4/hour  then  the  number  of  events  in  [0,2  I has  a Foisson  distri 
bution  with  expected  number  of  arrivals  equal  to  (4/hour)(2  hours)  = 8. 


If  N has  a Poisson  distribu- 
tion then 

n -\t 


P[N=nJ 


P[N=n  ] = 

n 1 


n! 


for  n = 0,1,2, 


0.2 

0.1 


U = 2 


If  \ = 4 and  t = 2 then 

_ (8)V8 


~5T 


092. 

hr,  it 


2.2.1  Ex  art  . : Ha  i n t a i r i < .*  < 

Consider  a battery  which  is  put  into  <r 
time  a failure  occurs  t h>*  fa  i led  bat  tery  is  re 


. : me  0 . 


is  installed.  If  the  life  lengths  of  th"  batteries  are 


and  a 


exponentially  distributed  with  failure’  rate 


l n u < ■ n e n : : 


tr  dl 


n ur: ! 


ures  in  [0,tj  has  a Poisson  distribution  with  expected  value  \t . 


i ) fa  i 1 - 


• f X = 4/year  then  the  expected  number  of  failures  in  one  year 
is  4.  The  probabi 1 ity  that  the  number  of  failures,  N,  in  one  year  wi 1 ; 
be  less  than  or  equal  to  4 is 


P[N<4J  = P [ N = 0 ] + P [ f J = 1 ] + ...  + P [ N = 4 ] = .639. 


2 . 3 Gamma  Distri but  ion 

The  gamma  distribution  has 
probability  density  function 


e(t) 


.a  a-1  -\t 
X_  t e 

r(a) 


for  t 2 0 


= 0 


elsewhere 


where  X > 0,  a > 0.  a is  the  shape 
parameter.  As  a increases,  the 
density  function,  g,  becomes  less 

peaked . 


When  a is  an  integer  the  gamma  distribution  may  be  thought  of  as 
the  sum  of  a independent  exponential  random  variables  each  with  failure 


Assume  that  a device  subject  to  an  environment  will  fall  when 
exactly  k 2 1 shocks  occur  and  not  before.  if  the  shocks  occur  with  a 
Poisson  distribution  with  rate  X.  * then  the  waitin'-;  time  until  the  item 
fails  is  described  by  a gamma  distribution  with  parameters  a = k and  X. 

When  0 < a < 1,  the  failure 
rate  is  decreasing.  When  a > 1, 
the  failure  rate  is  increasing.  r(t) 

When  a = 1,  the  failure  rate  is 

constant  , and  the  distribution 

is  exponential.  It  can  be  shown  2.0  ■ 

that  when  a > 1 the  failure  rate 

Is  bounded  above  by  X . 1 


X = 1 


• • V/eibul  1_  D i str  i bution 

The  Vie  i bu  11  di  st ri but  i on  i s 
defined  tv 


0.05 


a = 1 


a = 0.5 


a = 1.5 


a = 2 


a = 


F(t)  = 1-e" 


t 0 


'which  is  equivalent  to 


and  to 


R(t)  = e" 


f(t)  = Xata-1e“U  t > 0 


X = 1 


ia  = 3 


a = 2 


cl sewhere 


/\a  = 1 


w her e x , a > 0 , 


a = 0. 5 


"This  Is  equivalent  to  the  assumption  that  the  time  between 
shocks  has  an  exponential  distribution  with  failure  rate  X. 


a is  the  shape  parameter.  As  a increases  r(t  ) rises  more  steeply 
and  the  density  function  becomes  more  peaked.  X is  the  scale  param<  ter. 
Tii is  is  an  extreme  value  distribution  in  that  it  approximates  the  Limit- 
ing distribution  of  the  minimum  of  independent  random  variables. 

The  V/eibull  distribution  has  been  used  to  describe  fat  J rue  fail- 


ure, vacuum  tube  failure,  ball  bearing 
failure,  etc. 

When  0 < a < 1,  the  failure 
rate  is  decreasing.  When  a > 1, 
the  failure  rate  is  increasing. 

When  a = 1,  the  failure  rate  is 
constant  and  'the  distribution  is 
exponential.  It  can  be  shown  that 
when  a > 1 the  failure  rate  r(t)  is 
unbounded  as  t becomes  infinite. 


failure,  electronic  equipment 


r(t ) 


2 . 5 Mixed  Exponential  Distribution 

Let  be  the  life  length  of  a component  in  a service  environment 

with  a constant  failure  rate  X which  is  unknown.  The  variability  of 
manufacture  determines  various  percentages  of  the  X values  and  this 
variability  can  be  described  by  some  distribution,  say  G. 

i 

Assume  G is  a gamma  distribution.  When  x is  known  the  relia— 

Ibi  1 ity  is  given  by 

R(t)  = c'Xl  t » 0 

When  X is  unknown 

on 

R(t)  = / e g(  \)d  X = = exp  {-uf  n(  1 + tp)  > 

0 (Utp)a 


A burn  in  of  h unitr.  of  time  on  a component,  with  an  initial  life 
which  follows  mixed  exponential  distribution  with  parameters  a and  p 
has  a residual  life  which  follows  a mixed  exponential  distribution  with 


parameters  a and 


? 

1+h 


Note  that  for  fixed  t reliability  increases  as 


P (or  a)  decreases. 


2 . 6 Bernoulli  Distri but i < m 

Assume  that  the  time  to  failure,  T,  for  a new  component  follows 
some  probability  distribution  F.  If  we  fix  time  at  t and  are  concerned 
only  with  the  reliability  at  this  time  then  reliability  is  no  longer 
written  explicitly  as  a function  of  time.  if  the  distribution  F is 
exponential  then 

H(tQ)  = e_>a°  = p . 

If  the  distribution  F is  Weibull  then 

-\ta 

R(tQ)  = e o = p . 

Let  X = 1 if  T > t and  X = 0 if  T s t . The  Bernoulli  distri- 
bution has  a density  function  given  by 


p(x)  = p 


if  x = 1 


= 1 - p = q if  x = 0 


The  reliability  is  given  by  the  value  p. 
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mi xed-cxponenl i a l constant  failure  rate 
time  t estimate  of  reliability  estimate  of  reliability 
mi  nules  at.  time  t at  time  t 


10 

• 9'i 

.08 

100 

• 67 

. 80 

300 

.^9 

.50 

Oiven  data  from  two  dl 

fferent  lots  we  might  incorrectly 

d i s t i n 

gu  ish 

the  more  reliable  lot  j 

f we  assume  constant  failure  rate. 

Con- 

slder 

the  following  example: 

First 

Lata  Set 

Failure  times: 

1, 

8,  10 

Al ive  times : 

59, 

72,  76, 

113,  117,  1214 , 1H 5,  in 9, 

, 153,  182,  320. 

Second  Data  Set 

Failure  times: 

37, 

53 

Alive  times: 

60, 

614 , 66, 

70,  72,  96,  123. 

I f we  as 

sume 

that  th- 

o data  ore  observations  l 

’rom  an  exponential 

distribution  (constant  failure  rate  \)  then  we  have  the  following 

estimates: 


A 


Data  Let  1 

Data  Dot 

\ = .00197 

II 

O 

o 

LO 

time  t 

est  ima t. 

o of  re J[ i 

a b i 1 i t y 

estimate  of  re 

in  min. 

at  t 

in:-  t,  Rl 

(t) 

ri  L t i me  t/  , 

6 

10 

30 

50 

100 

130 


988 

.931 

980 

.969 

9 ii  3 

• 911 

906 

.856 

821 

.732 

77*1 

.667 

Looking  at  the  data  from  the  two  sots  wo  would  expect  teat  at  lea:' t for 
the  first  fifty  minutes  the  reliabi  llty  cst  ini.it  f for  the  second  sot  of 
data  would  be  higher  than  the  relial  ility  est  Lmate  f r the  first  set  >f. 


data,  because  in  the  first  set  3 failures  out  of 
in  the  first  ten  minutes  while  in  the  second  set 
9 trials  has  occurred  in  the  first  fifty  minutes, 
exponential  assumption  the  reliability  estimates 
are  consistently  higher.  See  Graph  JL . 


1*1  trials  have  occurred 
only  1 failure  out  of 
However,  under  the 
for  the  first  data  set 


If  we  assume  that  the  dat.a  are  observations  from  a mixed  exponen- 
tial distribut  ion  then  we  have  the  following  est imai.ee : 


t ime  t 
in  mi r. . 

Data  Set  1 

Data  Set  2 

estimate  of  reliability 
at  t i me  t , ft ^ ( t, ) 

estimate  of  reliability 
at  Lime  t , ft n ( t ) 

6 

.915 

• 976 

10 

.896 

.961 

30 

.855 

. 896 

50 

.836 

.8*4  3 

100 

.810 

.7*4  7 

130 

. 801 

• 705 

) _ 


Reliability 


Sraph  . . Mixed  i ■ ; jnential  As:  jnpt  ion 


> M ' 


N • ■ ' 1 . i ' ' : ■■  estimates  m m re  nsistenl  w i t h what  • h iat  : ■ w 
that  ■ , for  it  L< -a st  the  fir  t ■ ) minutes  w< 


estimate  for  the  second  set  >f  iat a • | hi  r tl 

• • t ■ : t • f r thi  first  set  : iata « Bey  ind  this  time , h wl  ;er,  . ay  it 
100  minutes , the  data  indicate  that  the  reliability  • st imat<  fror  the 
first  set  of  data  should  be  higher  than  the  reliability  estimate  fr.  :n 
thi  sec  nd  set  if  data.  Us 3 ng  mix<  J exf  nen tial  est imat  es  tiii:  is  th< 
case.  See  Granh  . 


A statist  iea]  *■  : 1 t.  * • dot  ormi  ne  who*  h*  ;•  ft 
or1  decreasing  fail  are  rat-  was  run  on  the  da*  a 
data  set  1 ws  r-  .i  ct  constant  r.siiui"  rat.-.'  3 : f 

ure  rate.  For  da  ‘ : se*  . cannot  reject  the 
assumption.  In  ‘his  can-- , irwever,  tiie  corn".  m!  f . 
for  reliability  and  the  mixed  expon  ntial  estimates 
close. 


j-  ' . j i na s a ■;  a n 

■orn  s.ets  1 ami  ?.  F r 
f deer-1  slni:  fail- 
ant  failure  rate 
Lure  rat  est imat* 
for  reliability  -are 


i 7 • , 

?on 


The  mixed  exponential  estimat.es 
minutes . ( S < Iraph  . Actually 
much  bey  nd  , minutes  since  we  do  not 
estimates . 


are  conservat ivo  to  about  70 
shoul  i rv-t  * s>t  irnate  reliability 
have  data  to  support  those 


Data  . ' - 1 1.  2 

mixed  exponential 


time  t 
in  min. 

exponential  estimate  of 
re  1 i ab  i 1 i t ,y  a t 1 i me  t , 

estimate  of  re 
K(t) 

6 

.981 

• 976 

10 

.969 

.961 

30 

.91 1 

.896 

50 

. 856 

.8H3 

70 

.80'l 

. 800 

100 

.73  2 

.7  n 

Reliability  Graph  i.  Exponent  in  1 and  Mi  /<M  Exp  'noritial  Assur'd  i 
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r Mi',  exponential  model 
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Goodness  of  Fit  Teats 


. i 


K . : - :•  V-.  mi rn 


lann , . . 


■ : . ' : : 


■ mg;  irwalla,  f . . . Moth  h ■’  r . ' ' it.  ist  i 
liability  ind  Li  it  ta,  W 5 ey~,  L9 


Musi  kr  parameters . hat  is,  if  w<  want  t test 
whether  or  not  the  data  is  a sample  from  a V.’eibull  diotri:  uti  . n 
must  . , :3  fy  the  va  lues  if  thi  W< ? it  ...  pai  et< >rs , X and  a . I 
testing  normality  and  for  testing  exponent  ia  Lity  this  rer.t  ricti 
of  knowledge  of  the  parameter  values  is  not  necessary  if  we  use 
Lilliefor  rs  alternati  V(  t<  Koli  r v-Smirn  v test. 


2}  In  general  the  data  must  be  uncertsored. 

3)  Test  is  applicable  to  small  samples. 

1.2  hi-squ  t ; in  ' ' ■ Tests  Si  indard  St  it  istical 


1)  Estimate  the  parameters  from  data. 

2)  Asymptotic  method. 

3)  Data  must  be  uncensored. 

Requires  a large  sample  si  so. 


2 . T<  . • . for  C ■ . . ■ ml  1 1 1 u n 
Failure  Rates 

. . Fii  elsl  1 , I . . 

(1971)  Improved  g . du". 

1)  Uncensc 


red 
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2.2  Gnedenko  Test  Gnedenko,  B.,  et  al.,  C 1969) 

Mathematical  Theory  of  Reliability,  Academic  Press. 

11  Censored  data. 

2)  Most  powerful  test. 

2.3  Test  of  Pit  for  a V/elbul  1 Distribution 
Mann  , et  al . , (197*0 

Mann  "LEAP"  Test 

1)  Censored  data. 

2)  Parameter  values  not  specified. 

3)  Powerful  test  against  checked  alternatives . 

IV.  POIIJT  ESTIMATES  FOR  COMPONENT  RELIABILITY 
1 • Point  Estimates  for  the  Exponential  Distribution 
Example  1.1  Complete  sample 

Lex  X^,...,X  be  a random  sample  from  a distribution  with  proba- 
bility density  function 

f(x;e)  = Xe"Xx  x > 0 


The  maximum  likelihood  estimate  for  X is  given  by 


X = 


n 


n 

2 X, 


>1 


Tne  maximum  likelihood  estimate  for  R(t)  is  given  by  e" 
Assume  4 items  of  a particular  type  are  tested. 


xx  = 30  min. 
x^  = 60  min. 
Xj  = 75  min. 
x^  = 93  min. 


X = 


T 

2 x , 


4 

25?S 


= .0155 


i = l 


R(  t ) = e‘U  = e-0155t 


If  t = 10  minutes  then  R(  10 ) = e~’^J  = .86 


^ > 
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Example  1.2  Type  II  censoring  (fixed  number  of  failures) 

Let  < X^.-^  < ....  < X(iij  be  an  ordered  sample  from  an 

exponential  distribution  v/ith  failure  rate  X.  Assume  Type  II 
censoring  at  the  r;  *n  failure. 

Let  the  total  tested  life,  T,  be  given  by 


= ^ X{1)  + <n-r)X(r) 


The  maximum  likelihood  estimate  for  X is 

? = £ 

• * rp 

The  maximum  likelihood  estimate  for  R(t)  is 


Assume  ten  items  are  put  on  test  and  tested  until  the  4th  item  fails. 

x(l)  * 30  min>  x(2]  ‘ 60  min*  x(3)  - 75  min,  x<4)  = 93  ™in 

Under  the  assumptions  listed  above  the  observed  value  of  T is 

30  + 60  + 75  + 93  + 6(93)  = 8l 6. 


X = ~ = 


1 nnc:  -Xt  -.005t 

,-r-  = .00  5 R(t)  = e = e 


A.  - ip  - ■gyg’  = .UU0  = e = e 

If  t = 10  minutes  then  R(10)  = e-’^*'  = .952. 


Compare  the  results  from  Examples  1.1  and  1.2. 

Example  1.1 
x^  = 30  min. 
x^  = 60  min. 
x^  = 75  min. 
x^  = 93  min. 

Sample  size  4 


Example  1.2 

x^  = 30  min. 

x^  = 60  min. 

x^  = 75  min. 

x^  = 93  min. 

Testing  is  stopped. 

The  remaining  6 items 
have  93  min . of  tested 
time  but  have  not  failec 


X = 2^5  = •°155 

R(t)  = e“  *01  55t 


X = 0=  -005 
R(  t ) = e"'005t 


R(  10 ) = .86  R( 10 ) = .95 

Example  1.3  Type  1 censoring  (fixed  test  time) 

Under  this  test  plan  we  put  n items  on  test  simultaneously  and 
test  until  time  T^.  All  failed  items  are  instantly  replaced.  All 

testing  stops  at  time  T . 
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Note  1:  The  total  accumulated  test  time  on  all  hardware  tested. 

Including  re p 1 a c e me n t , is  nT  . 

Note  2:  The  number  of  failures,  R,  is  random. 


Note  3:  At  all  times  in  (0,T  ) there  are  n items  on  test. 

The  time  between  failures,  Y,°has  an  exponential  distribution 
with  parameter  nX  , that  is,  fv(y)  = nXexp(-nXy)  y > 0. 

Note  4 : In  view  of  Note  3,  R,  the  number  of  failures,  is 

Poisson  with  mean  nXT  , that  is,  R is  P(n\T  ). 

o’  ’ o 

Note  rj:  The  total  number  of  items  put  on  test  is  n + R. 

The  maximum  likelihood  estimate  for  X is 


and  for  R(t)  is  e~  '" 

Example  1.4  Random  number  of  failures  and  random  test  time 

In  this  case  it  is  still  possible  to  obtain  a point  estimate 

for  X and  hence  for  e-Xt,  but  to  obtain  confidence  bounds  for  e-Xt 
is  very  difficult. 

The  maximum  likelihood  estimate  for  X is 

" _ number  of  failures 
x total  test  time 

2 . Point  Estimates  for  the  Gamma  Distribution 

See  Methods  for  Statistical  Analysis  of  Reliability  and  Life  Data 
by  Mann, "Schafer,  and  Singpurwaiia. 

3.  Point  Estimates  for  the  Weibull  Distribution  for  Censored  and 
Uncenscred  Data 

See  Methods  for  Statistical  Analysis  of  Reliability  and  Life  Data 
by  Mann,  Schafer,  and  Singpurwaiia. 

4.  Point  Estimates  for  the  Mixed  Exoonential  Distributions 


See  "Problems  of  Estimation  for  a Decreasing  Failure  Rate  Distri- 
bution Applied  to  Reliability,"  by  Hyhre  and  Saunders  (to  appear  in 
Technometrics ) . 

. Point  Estimates  for  the  Bernoulli  distribution 


If  x.,...,x  is  an  observed  sample  from  a Bernoulli  distribution 

(go/no-go),  then  the  maximum  likelihood  estimate  for  reliability  p, 
is  given  by 

* x,  + ..+x  number  of  successes 
_ __  1.  n = 

p n ~ number  of  items  tested 

For  example  if  n = 10  and  x.^  = 0,  x^  = 1,  x^  = 1,  x^  = 1,  = 1, 

Xf • - 1,  x7  = 1,  x0  = 0,  xQ  = 1,  xin  = 1 then 


p = 


V. 


- lU  - 

CONFIDENCE  BOUNDS  FOR  COMPONENT  RE  LI  ADJ  LI  TV 

1 • Review  of  Con  H dr:. <_■•••  Bounds 

Let  X^, ,X  be  a random  sample  from  a distribution  with 

density  function  f(x;0),  ’where  o is  an  unknown  parameter. 

For  example  X, , ...,X  could  be  a random  sample  from  a normal 
i n 

distribution  with  known  standard  deviation  o and  unknown  mean  0. 

o 


f(x;G)  = exp  " TT°~ 

O 2a 

O 


— <*>  < x < 


or  X^,...,Xn  could  be  a random  sample  from  an  exponential  dis- 
tribution with  failure  rate  0. 


f ( x ; 0 ) = 0e 


-Ox 


0. 


Two  sided  confidence  bounds  for  0 are  given  by  the  random 

interval  determined  by  Br(X, ) and  B (X1}...,X  ) 

Li  X n u l n 

where 

p[bl(x] . . ,xn)  < e < bu(x1>. . . ,xn) ] = p . 

p is  called  the  confidence  coefficient. 


Example  1 . 1 

Let  X^,...,X  be  -a  random  sample  from  a normal  distribution 
with  mean  0 and  known  standard  deviation  a. 


It  can  be  proved  that  Z = 


X-  0 


has  a normal  distribution 


a /'/n 

O v 

n X . 

with  mean  0 and  standard  deviation  1.  where  X = Z — 

i = l n 


The  confidence  Interval  is  obtained  from 

P(-z  £ -X~ 6 £ z)  = p 


This  is  equivalent  to 


(zo  _ zo  \ 

X £ 0 £ X + ^1=  p 

Vn 


Example  1.2  Larson,  "Introduction  to  Probability  Theory  and 
Statistical  Inference." 
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Suppose  that  the  number  of  ounces  which  a machine  puts  into  a 
bottle  can  be  represented  by  a normal  random  variable  with  unknown 
mean  6 and  known  standard  deviat ion  of  1/2  ounce.  Select  at  random 
25  bottles  which  have  been  filled  by  this  machine.  Let  X, ,X, , . . . ,X~r , 

l 2 _ 2 p 

respectively,  denote  the  number  of  ounces  they  contain.  Then  X is  a 

normal  random  variable  with  mean  G and  standard  deviation 

1/2/725  = 1/10.  If  we  want  95£  confidence  bounds  on  0 then  from 
the  normal  table 

P(-1.96  < 5 1.96)  = .95 

which  is  equivalent  to 


P(X  -1.96  ~<  0 5 X + 1.96  — 9 = .95 


If  the  obse 

rvc-d 

values  of 

the 

i* an  do m 

sample 

are  : 

x x = 12.0 

x6 

= 12.3 

X11 

= 12.4 

xl6 

= 1 ] . 6 

X21 

1] . 9 

x0  = 12. 8 

X? 

= 11.5 

X12 

= 11.6 

x17 

= 11.9 

X22 

12.1 

x 2 = 11.9 

x8 

= 11.  4 

X1 3 

= 12.1 

X1 8 

= 11.5 

X?  3 

12.3 

X 

-Cr 

II 

M 

OO 

Y 

9 

= 12.2 

xl4 

= 12.4 

x19 

= 12.0 

x2  4 = 

11.8 

x5  = 12.1 

x10 

= 13.0 

X15 

= 11.8 

:<2G 

= 12.2 

X25  = 

11.7 

Then 

X = 12.0 

Bl  = 12.0  - 1.96(1/10)  =12.0  - .2  = 11.8 
Bu  = 12.0  + 1.96(1/10)  = 12.0  + .2  = 12.2 


2 . Confidence  Bounds  for  the  Exponential  Distribution 

Example  2.1 

Let  X^,...,Xn  be  a random  sample  from  a distribution  with 
probability  density  function 

f(x;0)  = Xe  X'x  x > 0 
n 2 

It  can  be  shown  that  Y = 2\  x X.  has  a X„  distribution  (a  chi- 

i=l  1 

square  distribution  with  2n  degrees  of  freedom). 


/ 


This  is  equivalent  to 


rj  a , b 

P 2ZX1  < ' < 


- P • 


If  the  X,,...,X  denote  life  times  for  some  particular 

1 ’ ’ n 

of  equipment  then  the  reliability  at  time  t is  given  by 


piece 


A confidence  interval  for  R(t)  is  obtained  by 
p e-bt/2zXi  < e-Xt  < e-at/2ZXi 


= P • 


Using  the  data  from  Example  1.1  of  Section  IV  with  p = 
n = 4 , we  have  a = 2.73  and  b = 15.5,  a 90%  confidence  inter 

R(t)  = e-*^  is 

(exp-TT^i-HT  t,  exP"F(ii8T  1 5 


.90  and 
val  for 


•exp-2T25BT  L’  "■ 

-.030t  -.005t 


If  t = 10  minutes  then  the  90%  confidence  interval  for  R(t) 

(.74,  .95). 

Example  2.2  Type  II  censoring( fixed  number  cf  failure.-.} 


Let  X(l)  ' X(  2 ) ' 


X,  j be  an  ordered  s am  pie  frc: 


exponential  distribution  with  failure  rate 
Assume  Type  II  censoring  at  the  failure. 

Let  the  total  tested  life,  T,  be  given  by 


T - + (n-r)X(jl)  . 


Epstein  and  Sobel  (1953)  proved  that  Y 
distribution  with  2r  degrees  of  freedom. 


2 XT  has  a X‘ 


lOOp?  confidence  bounds  for  X are  obtained  from  using  the  fact  that 

P( a < 2 XT  < b)  = p 


P(a/2T  < \ < b/2T)  = p 


- 17  - 

Two  sided  confidence  bound.;  for  the  reliability  at  tine  t are 
obtained  from 

P(0-bl/2T  < c‘U  < =-at/2T)  = u . 

A lower*  p + (~^-)  bound  is  obtained  from 

P(e-(b/2T)t  < e’U)  - p + (±=£)  . 

Using  the  data  from  Example  1.2  of  Section  IV,  the  degrees 
of  freedom  for  the  X distribution  are  2r  = 8.  If  p = .90 
then  a = 2.73  and  b = IS. 5. 


Two  sided  90%  confidence  bounds  for  e Xb  are 
15.5  273 

e-.0095t  = e'l532  < e-Xt  < e"l^32  = e-.0017t 

If  t = 10  minutes  then  the  bounds  become  (.91,  -98)  . 

The  one  sided  95%  = (90  + l lower  bound  is 

e-.0095t  < e-Xt  > 

Example  2.3  Type  I censoring  (fixed  test  time) 

Under  this  test  plan  we  put  n items  on  test  simultaneously 
and  test  until  time  T . All  failed  items  are  instantly  replaced. 
All  testing  stops  at  Sime  T . See  Example  1.3  of  Section  IV. 


It  can  be  shown  that  if  b is  the  lOOp  percentile  point  from 

a X2  distribution  with  2(R+1)  degrees  of  freedom  then  an  upper 
100p%  confidence  bound  for  X.  is  obtained  by 

P(2n\T  < b)  = p 
o r 

PU  < 2*r0  > ■ f* 


A lower  100PS  confidence  bound  for  e Xb  is  obtained  by 


_bt_ 

P(  e’2n'T°  < e 


-\t 


} = P b 


so  that  the  lower  bound  on  R(t)  is  e 


2nT, 


If  n * 8,  T = 102  and  R is  observed  at  r = 3 then 
o 


V 

> 


for  p ■ .95,  b = 15.5  (recall  that  the  degrees  of  freedom  on  the 

X2  is  2(r+l)  where  r is  observed  number  of  failures  in  the  fixed 
tine  nTQ)  . Thus, 

t 


▼ 


^ 


- i8 


bt 

2nT 


lf>  32 


t and 


e-°°95t  < e-U  , R(l) 


with  probability  .95. 

3.  Confidence  Bounds  for  Gamma  Distribution 

See  Met  hods  for  Statistical  Anal  ys  is  of  He  1 i ab  1 1 i t y an  d Li  f e 
Data  by  Mann,  Schafer,  and  Singpurwalla. 

^ • Confide nee  Bounds  for  the  Welbull  Distribution  for  Censored  and 
Uncensored  Data 

See  "An  Exact  Asymptotically  Efficient  Confidence  Bound  for 
Reliability  in  the  Case  of  the  Weibull  Distribution,"  by  Johns 
and  Lieberman,  Technometrics , Vol.  8,  Mo.  1,  Feb.  1966;  also, 
Methods  for  Statistical  Analysis  . . . , by  Mann,  Schafer,  and 

Singpurwalla. 

5 . Confidence  Bounds  for  Bernoulli  Distribution 

Let  X^,...,Xn  be  a random  sample  from  a Bernoulli  distribution. 

Example  5-1 

n 

Assume  that  Z x.  = k,  that  is,  k successes  out 
1 = 1 1 

of  n trials.  A 952  lower  confidence  bound,  p,,  for 
p is  the  value  of  p for  which 

£(;) pyn-P>"-y  - .Ob 


If  k = 0 then  p^  = 0. 

To  illustrate:  if  n = 10,  k = 8 and  confidence 
coefficient  = .95  then 


10  , X 

£a  y )<-5Uy<.«6>10-y  - 

y=8  ' x/ 


• 05 


Thus  if  p s .54  the  probability  of  observing  8 or  more  successes  in 
10  trials  is  5 .05. 


U'> 


j_L 


.05 


T f f~T  t 


19  - 


I 


- ?0  - 


Solve  for  p^p^.  The  confidence  interval  becomes  (p^,p^).  For 
example,  if  n = 100,  ZX^  = 65  and  p = .95  then 


P 


-1.96 


EX^-np 
/np ( 1-p) 


< 


1-96 

J 


^ .95 


65- 3 00 n _ 

lojp(l-p) 


< 2 


10,'JOOp2 


1 ^ 0 0 p + UF25  < 0. 


Roots  are  p^  = .55 


( . 55 , .7^)  is  an  approximate  95$  confidence  interval  for  p. 
.55  is  a lower  57-5$  confidence  interval  for  p. 
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PRELIMINARY  DRAFT 


APPROXIMATE  CONFIDENCE  BOUNDS  FOR  RELIABILITY: 

MIXED  EXPONENTIAL  DISTRIBUTION 

I.  Introduction 

The  mixed  exponential  model  for  the  probability  that  a com- 
ponent (or  system)  is  successfully  operating  at  time  t,  R(t)  = 

(1+pt)  a,  was  developed  for  use  where  the  exponential  model  had 
been  assumed  but  the  data  showed  a decreasing  failure  rate  [2]. 

The  maximum  likelihood  estimates  of  the  parameters,  either 
singularly  or  jointly,  have  been  shown  in  [1]  to  be  fairly  accurate 
and  in  general  preferable  to  using  the  bes't  linear  unbiased  estimate 
of  p.  The  estimates  obtained  by  the  method  of  moments  are  quite 
inaccurate . 

A A 

Since  the  joint  maximum  likelihood  estimate  of  a and  p,  (a,p), 
is  not  available  in  closed  form,  it  is  difficult  to  obtain  the 

A A 

joint  distribution  of  (a,p)  and  hence  difficult  to  derive  an  exact 
lower  confidence  bound  on  reliability.  It  has  been  shown,  however, 
that  for  fixed  a and  type  II  censoring  of  the  data  the  distribution 

a 

of  p/p  is  independent  of  p.  In  addition,  it  has  been  shown  [3] 
that  for  fixed  a and  general  censoring  (type  II,  type  I or  general 

a 

time  censoring)  the  distribution  of  p/p  is  asymptotically  normal 
and  independent  of  p as  the  sample  size  and  number  of  failures 
become  large.  In  these  cases  confidence  bounds  for  p and  hence 
for  reliability  can  be  obtained  using  either  the  simulated  distri- 

A 

bution  of  p/p  or  when  appropriate  the  asymptotic  normal  distribution 

A 

of  p/p. 


If  a is  unknown,  section  IV  gives  a method  for  obtaining 
approximate  confidence  bounds  for  reliability.  Simulations 
demonstrate  the  accuracy  of  these  bounds  as  a function  of  sample 
size,  number  of  failures  and  confidence  level. 

A 

II.  The  Distribution  of  (3  when  g is  Known 
For  known  scale  parameter  a it  is  shown  in  [2]  that  the 

a a 

distribution  of  p/p  is  independent  of  p,  where  p is  the  maximum 
likelihood  estimate  of  p from  a sample  of  size  n with  k failures. 
While  this  distribution  is  independent  of  p,  it  does  depend  on 
n,  k,  and  a,  thus  it  is  necessary  to  know  the  distribution  for 
each  triple  (n,k,a).  If  the  distribution  is  known  then  upper 

a 

(lower)  bounds  can  be  found  for  p since  if  P[p/p>b]  = a then 

A 

P[p/  >p]  = a.  From  this  expression  lower  confidence  bounds  on 
the  reliability  R(t)  = (l+pt)-a  can  be  derived. 

A 

For  each  triple  (n,k,a)  with  p = 1,  2500  p's  were  simulated 
and  the  resulting  percentiles  of  the  distribution  obtained.  These 
simulations  were  done  for  a=  .05,  .1,  .2,  . . . , .9,  1.0,  1.2, 

. . . 3-0,  n = 25,  50,  100,  200  and  a range  of  k's  appropriate 
for  each  n (i.e.,  for  n = 100,  k = 5,  10,  20,  . . . 100). 

The  graphs  of  these  simulations  appear  to  be  approximately 
normal  for  all  but  small  k and  thus  illustrate  the  result  proven 

A 

in  [3]  that  the  distribution  of  p/p,  for  fixed  a,  is  asymptotically 
2 

N(l,o  ),  where 

k V1 

r r(n+l)r(n-l+l+2/q) 

1Z1  f(n-i+l)r(n+l+2/a) 


- 3 - 

To  determine  the  values  of  (r.,k,a)  for  which  the  above  approxi- 
mation holds,  one  hundred  simulation  sets  are  run  for  each  (n,k,a), 

A 

where  in  each  simulation  set  one  hundred  p's  are  estimated.  Each 

A 

simulation  set  sample  of  p's  is  tested  by  the  Kolmogorov-Smirnov 

2 

goodness  of  fit  test  for  a N(l,a  ) distribution. 


Compilation  of  computer  results 
to  be  inserted  here. 


In  checking  the  distribution  p/p  the  mean  has  been  computed 
for  each  sample  and  is  aluiayi,  slightly  longer  than  one,  say  1.023. 
Thus,  even  though  the  distribution  appears  to  be  normal  it  may 
be  necessary  to  use  a more  accurate  mean  to  get  the  proper  fit. 

III.  Percentiles  of  the  p/p  Distribution 

A 

Since  the  percentiles  of  the  p/p  distribution  depend  on 
(n,k,a),  the  variation  in  the  percentiles  were  studied  as  func- 
tions of  a and  k.  For  a fixed  n and  k it  appeared  that 
the  90th  percentile  point,  b,  was  log  log  related  to  a.  Linear 
regressions  were  run  to  fit  ebssm(lna)  + c and  these  were  found 
to  be  significant.  Further  study  indicated  that  these  90th 
percentile  points  were  linearly  related  to  1/a.  When  regressions 
were  run  for  fixed  n and  k to  fit  b=m(l/a)  + c,  where  a varies 

through  .05,  . 1,  .2,  . . . , .9,  1.0,  1.2,  . . . 3.0,  the  results 

2 

ere  excellent  with  R >99.  The  bounds  were  also  found  to  be 

linear  functions  of  1/k  when  n and  a were  fixed,  and  when  regressions 

were  run  to  fit  b»m(l/a)  + n(l/k)  + c the  results  were  good  with 
2 

multiple  R > 90.  Similar  results  were  found  to  hold  for  the 


80th  percentile  points. 


4 


IV.  Confidence  Bounds  on  Reliability 

A 

With  our  knowledge  of  the  distribution  of  p/p  it  is  easy 
to  construct  a lower  bound  on  reliability  if  the  shape  parameter, 

A 

a,  is  known.  If  P[ p/p  > b]  = y then  for  all  t > 0 and  a > 0 
P[(l+p/bt)-a  < (l+pt)-a]  = y.  Thus,  if  a is  known  a priori  and 
if  b can  be  determined  for  the  particular  n,  k,  and  a,  then 

A 

R(t)  = (l  + p/bt)"ais  a lower  confidence  bound  on  the  true  relia- 
bility at  a y level  of  confidence. 

Unfortunately  in  most  applications  a is  unknown  and  a and  p 
must  be  jointly  estimated.  In  this  case  it  is  proposed  that 
R(t)  = (l+At)-a  be  used  as  the  y-confidenc'e  level  lower  bound 

A »"s  A 

on  reliability  where  A=p/b^~^  and  b(a)  is  the  y-level  bound  on 

A A A A 

p/p  assuming  the  true  a = a.  If  in  fact  p/b  > p and  a > a then 
R(t)  will  be  a lower  bound  on  R(t)  for  all  t,  but  in  other  cases 
R(t)  may  be  lower  than  R(t)  for  some  t but  not  others.  Thus 
the  validity  of  R(t)  must  be  shown  on  an  appropriate  time  interval 
through  computer  simulation. 

A 

As  a is  seldom  one  of  the  a for  which  the  distribution  of 

A A 

p/p  is  known,  a major  problem  has  been  to  calculate  b(a).  This 
has  been  solved  by  either  using  the  linear  model  b=m(l/a)  + c, 
where  the  model  is  known  for  particular  n and  k,  or  by  assuming 

A 

that  the  distribution  p/p  is  normal  with  p.  = 1 (or  l+€)  and 
2 J J f(n+l)r(n+ 1-1+2/ q)l  '1 

[l,1r(n+1-i)Itn+1+2/a)  J 

In  either  case  to  test  the  validity  of  R(t)  for  a fixed  a,  p,  n,  k 

A 

two  hundred  pairs  of  estimates  (4,p)  are  generated  and  for  each 
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A 

pair  R(t)  = (l  + P/b^^t)  ° is  computed  at  each  time  tp,  p = 80,  8l, 

. * . , 99  where  R(tp)  = P-  The  R(tp)  are  compared  with  the 

true  reliability  at  each  of  the  20  times  and  the  results  averaged 

over  all  200  pairs  to  determine  the  percentage  of  time  that  R 

is  actually  lower  than  the  true  reliability.  As  the  percentage 

that  results  may  be  high  because  the  bounds  are  too  conservative, 

or  be  low  because  they  are  too  optimistic,  each  R(t)  is  raised 

by  .01  for  all  the  t and  lowered  by  .01  for  all  t and  the 

P P 

corresponding  percentages  computed.  For  example,  we  simulated 

A a 

for  n = 100,  k=30,  a=  •!»  p = *3  two  hundred  (a,P)  and 
generated  9055  bounds  R(t  ) for  p = .80,  .81,  . . .,.99  using 

r 

the  linear  model  b=m(l/“)  + c.  For  this  case, 

R(tp)  is  less  than  the  true  reliability  9255  of  time 
R(tp)-.01  is  less  than  the  true  reliability  96?  of  time 
R(tp)+.0i  is  less  than  the  true  reliability  76?  of  time. 

This  shows  a fairly  tight  lower  bound.  When  using  b=^+a^^a  on 
the  assumption  that  the  distribution  is  normal,  the  percentages 
are  9555*  98?,  88?,  indicating  that  R(t)  is  quite  conservative 
and  the  normal  approximation  does  not  fit  well. 

The  following  table  indicates  the  accuracy  of  the  approximate 
bounds  and  the  value  of  n,  k,  and  “ for  which  the  normal  approxi- 
mation bounds  are  accurate. 


Compilation  of  computer  Results 


to  be  inserted  here. 


References 


[1]  Lucke,  J.,  Myhre,  J.,  and  Williams,  P.  "Comparison  of 
Parameter  Estimation  for  the  Pareto  Distribution."  Sub- 
mitted to  the  Journal  of  the  American  Statistical  Association 

[2]  Myhre,  J.,  and  Saunders,  S.  "Problems  of  Estimation  for 

a Decreasing  Failure  Rate  Distribution  Applied  to  Reliability 
Submitted  to  Technometrics . 

[3]  Myhre,  J.,  Saunders,  S.,  and  Nunke,  M.  "Asymptotic  Distri- 
bution of  Maximum  Likelihood  Estimates  for  Parameters  of 
the  Mixed  Exponential  Distribution  based  on  Censored  Data." 

To  be  submitted  to  Technometrics. 


